Information storage medium including markup document and av data, recording and reproducing method, and reproducing apparatus therefore

ABSTRACT

An information storage medium including a markup document and AV data for use in a reproducing apparatus includes AV data including audio data and video data, a markup document, and scene synthesis information which describes one of at least two display modes for displaying a markup document scene obtained from the markup document and an AV scene obtained from the AV data together.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 10/278,092,filed Oct. 23, 2002, currently pending, which claims the benefit ofKorean Patent Application Nos. 2001-65388, 2002-14586, and 2002-30609,filed Oct. 23, 2001, Mar. 18, 2002, and May 31, 2002, respectively inthe Korean Intellectual Property Office, the disclosures of which areincorporated herein in their entirety by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a method of displaying audio/video (AV)data together with a markup document, and more particularly, to aninformation storage medium including a markup document and AV data sothat the markup document and the AV data can be reproduced and displayedtogether in various ways in an interactive mode, a recording and areproducing method, and a reproducing apparatus therefore.

2. Description of the Related Art

Digital video discs (DVDs) (hereinafter, referred to as “interactiveDVDs”) on which a markup document is recorded together with audio/video(hereinafter, referred to as AV data), have been initially developed formovie applications. However, the interactive DVDs have started to bewidely used in the computer industry. The AV data recorded on theinteractive DVDs can be reproduced in two ways: a video mode which isdisplayed identically as compared to a conventional DVD, and aninteractive mode in which reproduced the AV data is displayed in adisplay window defined by a markup document. If the interactive mode isselected by a user, a viewer installed in a DVD reproducing apparatusdisplays the markup document recorded on an interactive DVD. The AV dataselected by the user is displayed in the display window of the markupdocument. For example, when the AV data is a movie, the movie is run inthe display window of the markup document, and various additionalinformation including scenario, history, and actors' pictures related tothe movie are displayed in the remaining part of a screen excluding thedisplay window of the markup document. The additional informationincludes image files or text files.

However, until now, in the interactive mode, the AV data is based on asimple displaying method in which the AV data is displayed through thedisplay window defined according to grammar of markup languages.

SUMMARY OF THE INVENTION

To solve the above and other problems, it is an object of the presentinvention to provide an information storage medium including AV data anda markup document so that the AV data and the markup document can bereproduced and displayed in various ways in an interactive mode, arecording method, a reproducing method, and a reproducing apparatustherefore.

It is another object of the present invention to provide an informationstorage medium including the AV data and a markup document so that theAV data and the markup document can be displayed in various ways in aninteractive mode according to a resolution and an aspect ratio (screenratio), which are set by a user or set in a reproducing apparatus, arecording method, a reproducing method, and a reproducing apparatustherefore.

It is still another object of the present invention to provide aninformation storage medium including interactive contents manufacturedat a fixed aspect ratio so that the interactive contents can beeffectively displayed on a display having various aspect ratios, arecording method, a reproducing method, and a reproducing apparatustherefore.

Additional objects and advantages of the invention will be set forth inpart in the description which follows and, in part, will be obvious fromthe description, or may be learned by practice of the invention.

Accordingly, to achieve the above and other objects according to anembodiment of the present invention, there is provided an informationstorage medium includes AV data including audio data and video data, amarkup document, and scene synthesis information which describes one ofat least two display modes for displaying a markup document sceneobtained from the markup document and an AV scene obtained from the AVdata together.

According to an aspect of the invention, the scene synthesis informationincludes a link tag recorded in the markup document, and the scenesynthesis information includes a cascading style sheet (CSS) inserted inthe link tag.

According to another aspect of the invention, the CSS includes at leastone of display mode designation information for designating a displaymode of the AV scene, AV trimming area designation information fordesignating an area to increase and reduce a desired portion of the AVscene, background color designation information for designating abackground color of the AV scene, trimming area designation informationfor designating a trimming area of a scene in which the AV scene issynthesized with the markup document, window designation information fordesignating a window in which a scene where the AV scene is synthesizedwith the markup document is displayed on the screen of a display, screendisplay type information representing an aspect ratio of a scene inwhich the AV scene is synthesized with the markup document scene, andwindow designation information of the AV scene for designating an areaof a window in which a trimmed AV scene is displayed on the screen ofthe display.

According to a further aspect of the invention, the scene synthesisinformation further includes an object having property variables forcontrolling the CSS and a program for controlling the CSS on the basisof the object.

According to another embodiment of the present invention, a method forrecording AV data, including audio data and video data on an informationstorage medium, comprises recording the AV data, recording a markupdocument to be displayed together with the AV data, and recording scenesynthesis information which describes one of at least two display modesfor displaying a markup document scene obtained from the markup documentand an AV scene obtained from the AV data together.

According to an aspect of the invention, the AV data is recorded in avideo directory, the markup document is recorded in an interactivedirectory, and the scene synthesis information is recorded in theinteractive directory.

According to another aspect of the invention, contents which are to bedisplayed are recorded in a maximum area shown regardless of an aspectratio of the display (i.e., in a hot area), and unimportant contents arerecorded or any contents are not recorded in the other area, wherein,when the markup document having a first aspect ratio is displayed on adisplay having a second aspect ratio having a resolution lower than thatof the first aspect ratio, the hot area is selected using the trimmingarea designation information of the synthesized scene, and the selectedhot area is mapped to a designated area on the screen of the displayusing the window designation information of the synthesized scene.

According to still another embodiment of the present invention, a methodfor reproducing AV data, including audio data and video data recorded onan information storage medium comprises interpreting a markup documentto be displayed together with the A data, interpreting scene synthesisinformation which describes at least two display modes for displaying amarkup document scene obtained by reproducing the markup document and anAV scene obtained by reproducing the AV data together, and displayingthe AV scene and the markup document scene in one of the display modesaccording to the interpreted scene synthesis information.

According to still yet another embodiment of the present invention, amethod for reproducing AV data, including audio data and video datahaving a predetermined aspect ratio recorded on an information storagemedium and a markup document having a predetermined aspect ratio anddisplaying the AV data and the markup document, the method comprisesreading scene synthesis information corresponding to a scene mode set ina reproducing apparatus or set by a user, and interpreting the readscene synthesis information, displaying an AV scene obtained byreproducing the AV data and a markup document scene obtained byreproducing the markup document to be displayed together with the AVdata, and changing the output state of the markup document scene inresponse to a scene mode change.

According to a further embodiment of the present invention, an apparatusfor reproducing AV data, including audio data and video data recorded onan information storage medium, includes a reading unit which reads theAV data and a markup document to be displayed together with the AV data,a decoder which decodes the AV data read by the reading unit and outputsan AV scene, and a controller which interprets the markup document readby the reading unit, outputs a markup document scene, interprets scenesynthesis information which describes at least two display modes fordisplaying the markup document scene together the AV scene, and displaysthe AV scene and the markup document scene in one of the display modesaccording to the interpreted scene synthesis information.

According to a yet further embodiment of the present invention, anapparatus for reproducing AV data, including audio data and video datarecorded on an information storage medium, includes a reading unit whichreads the AV data and a markup document to be displayed together withthe AV data, a decoder which decodes the AV data read by the readingunit and outputs an AV scene, and a controller which interprets scenesynthesis information corresponding to a scene mode set by one of thereproducing apparatus and a user, interprets the markup document to bedisplayed together with the AV data read by the reading unit using theinterpreted scene synthesis information, displays a markup documentscene, and changes the output state of the markup document scene inresponse to a scene mode change.

BRIEF DESCRIPTION OF THE DRAWINGS

The above objects and advantages of the present invention will becomemore apparent by describing in detail embodiments thereof with referenceto the accompanying drawings in which:

FIG. 1 is a block diagram of a DVD reproducing apparatus according to anembodiment of the present invention;

FIG. 2 is a reference diagram illustrating a screen alignment order(Z-order) of a display (not shown) connected to the apparatus of FIG. 1;

FIG. 3 shows the structures of files of the DVD 100 of FIG. 1 accordingto an aspect of the present invention;

FIG. 4 shows a picture in picture (PIP) mode, as one display modeaccording to the present embodiment;

FIG. 5 shows an embedded mode, as one display mode according to thepresent embodiment;

FIG. 6 shows a background mode, as one display mode according to thepresent embodiment;

FIGS. 7A through 7D show reference diagrams more specificallyillustrating a display mode of the AV scene and the markup documentscene according to a video-viewport and a video-placement;

FIGS. 8A through 8C show reference diagrams more specificallyillustrating a display mode of the AV scene and the markup documentscene according to a viewport and window;

FIG. 9 is a flowchart illustrating an embodiment of a reproducing methodaccording to the present invention;

FIG. 10 is a flowchart specifically illustrating operations subsequentto operation 903 of FIG. 9;

FIG. 11 is a flowchart illustrating an embodiment of a recording methodaccording to the present invention;

FIGS. 12A through 12F show a reference diagrams illustrating a methodfor displaying AV data and a markup document while minimizing adistortion of interactive contents in various displays having differentscreen ratios;

FIGS. 13A through 13C show reference diagrams illustrating scenes inwhich AV data for a 16×9 screen is displayed on a display having a 4×3screen in a letter box shape and a pan-and-scan shape;

FIG. 14 shows a reference diagram illustrating a markup document using ahot area;

FIGS. 15A and 15B show variations in coordinate systems needed inmapping the area selected using the viewport to the area designatedusing the window;

FIG. 16 is a flowchart of another embodiment of a reproducing methodaccording to the present invention FIGS. 17A through 17D show referencediagrams in which AV data for a 16×9 screen is synthesized with a markupdocument for a 4×3 screen in embedded, background, and PIP modes,respectively,

FIGS. 18A and 18B show reference diagrams in which the AV data for 16×9is synthesized with the markup document for 4×3 in a background mode,and then is displayed on a display having a 16×9 screen size;

FIGS. 19A through 19F show reference diagrams illustrating a display, amarkup document, and AV data according to different aspect ratios;

FIGS. 20A and 20B show reference diagrams illustrating the ratio ofwidth to length in pixels in a display having a 16×9 screen size and theratio of width to length in pixels in a display having a 4×3 screensize;

FIG. 21 shows a reference diagram illustrating various aspect ratioconversions;

FIGS. 22A through 22C show reference diagrams in which AV data for 16×9and a markup document for 4×3 each having a window area are synthesizedwith each other, and then is displayed on a display having a 16×9 screensize; and

FIG. 23 is a flowchart of another preferred embodiment of a reproducingmethod according to the present invention.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Reference will now be made in detail to the present embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings, wherein like reference numerals refer to the like elementsthroughout. The embodiments are described below in order to explain thepresent invention by referring to the figures.

Meanings of terms used in the description are as follows. “Markupdocument” is a markup document and a markup resource including variousimage files and graphic files inserted in the markup document. “Markupdocument scene” is a scene in which the “Markup document” is displayedby a viewer. “AV scene” is a scene in which audio/video (AV) data isdecoded and displayed. “Scene synthesis information” is information onthe definition of a method for displaying the markup document scene andthe AV scene together according to the present invention.

FIG. 1 is a block diagram of a reproducing apparatus according to anembodiment of the present invention. Referring to FIG. 1, thereproducing apparatus displays the AV scene and a markup document scenetogether. The AV scene and the markup document scene are obtained bydecoding AV data and a markup document recorded on an optical disc 100according to the present embodiment in an interactive mode by adisplaying method according to the present invention. The reproducingapparatus includes a reading unit 1, an AV decoder 2, a presentationengine 3, and a blender 4.

The reading unit 1 reads the AV data, the markup document, and scenesynthesis information from the optical disc 100 and provides the read AVdata, the read markup document, and the read scene synthesis informationto the AV decoder 2 and the presentation engine 3. In addition, thereading unit 1 may include a buffer memory (not shown) and a cachememory (not shown), for buffering the read AV data and caching the readmarkup document, respectively. However, the buffer memory and/or cachememory are not required in all aspects of the invention.

The presentation engine 3 supports a display mode according to thepresent invention. From the viewpoint of a software unit, thepresentation engine 3 includes a viewer, which is an application tointerface with an operating system of the reproducing apparatus throughan application program interface (API), and a client interpretationengine. The API is a predetermined special method for requestingprocessing of an operation system or another application. The clientinterpretation engine is implemented with a JavaScript or Javainterpretation engine, interprets a program coded with JavaScript orJava, like a web browser and executes the program. Furthermore, thepresentation engine 3 may further include a Plug-In. The Plug-In enablesfiles in various formats included in the markup document or called bythe markup document, to open. It is understood that other languages andprograms can be used with the markup document.

The presentation engine 3 interprets the scene synthesis information andtransmits a decoding command and a display command according to theresult of interpretation to the AV decoder 2 and the blender 4,respectively. The presentation engine 3 also provides the markupdocument scene to the blender 4. The AV decoder 2 decodes the AV dataaccording to the provided decoding command and outputs the decoded AVdata to the blender 4. The blender 4 displays the markup document sceneand the AV scene together according to the display command.

In order to perform a reproducing method according to an aspect of thepresent invention, the presentation engine 3 calls a style sheet linkedto or embedded in the markup document manufactured by the reading unit 1and interprets the style sheet. Information on a method for synthesizing(displaying) the markup document scene and the AV scene is described inthe style sheet. Of course, it is understood that methods other thanstyle sheets can be used to convey such information.

In order to perform the reproducing method according to another aspectof the present invention, the presentation engine 3 interprets a screenmode (aspect ratio, resolution, and video output mode) set in thereproducing apparatus or set by the user. The presentation engine 3outputs a command according to the set screen mode using the scenesynthesis information which is defined using a default style sheet setin the reproducing apparatus or a style sheet provided by amanufacturer. For instance, the style sheets could use a viewport fordesignating a trimming area of a scene in which the AV scene and themarkup document scene are synthesized with each other, a window fordesignating a window of the screen in which the AV scene and the markupdocument scene are synthesized with each other, and a video-viewport fordesignating an area to increase and reduce a desired portion of the AVscene.

If the screen mode is changed by the user, the presentation engine 3outputs a command according to the changed screen mode using the scenesynthesis information (e.g., viewport, window, and video-viewport).

In addition, a switching unit may be included in the AV decoder 2.

When a display is set to a 4×3 screen size, the AV decoder 2 converts anAV stream into a letter box or pan-and-scan shape and outputs theconverted AV stream. When the display is set to a 16×9 screen size, theAV decoder 2 outputs the AV stream in a 16×9 screen size withoutconversion. This is because the AV stream is generally encoded in the16×9 screen size in the DVD reproducing apparatus. However, when thedisplay mode in the interactive mode is an embedded mode or picture inpicture (PIP) mode, the AV decoder 2 can output the AV stream in the16×9 screen size without converting the AV stream into a letter box orpan-and-scan shape according to an “Initial Display aspect ratio,” inwhich an aspect ratio preferred by the user is initially set in thepresentation engine 3 even in a display having the 4×3 screen size.

Specifically, when the AV data for the 16×9 screen size is displayed onthe display having the 4×3 screen size, the presentation engine 3controls the AV decoder 2 to output the AV data in the 16×9 screen sizein the embedded mode of the interactive mode or the PIP mode. The outputAV data is output in a pan-and-scan or letter box shape in a backgroundmode of the interactive mode or the video mode. However, the AV data mayalso be output in the pan-and-scan or letter box shape from the AVdecoder 2 even in the embedded mode of the interactive mode or PIP mode.

In order to perform the reproducing method according to still anotherembodiment of the present invention, the presentation engine 3interprets the viewport and the window (document-viewport,document-window) only for the markup document defined in the scenesynthesis information, respectively, and the viewport and the window(video-viewport, video-window) only for the AV data.

In order to perform the reproducing method according to yet stillanother aspect of the present invention, unlike the AV decoder 2 havingthe switching unit, even though the display is set to the 4×3 screensize in the embedded mode or PIP mode, the AV decoder 2 having noswitching unit outputs the AV stream for the 16×9 screen size in such away that the display is set to the 16×9 screen size without outputtingthe AV stream in the letter box or pan-and-scan shape according to theviewport and window only for the interpreted markup document and theviewport and window only for the AV data.

FIG. 2 is a reference diagram illustrating a scene alignment order(Z-order) of a display (not shown) connected to the reproducingapparatus of FIG. 1. Referring to FIG. 2, a final scene shown to theuser is generated by four scenes 21, 22, 23, 24 added physically (i.e.,stacked sequentially). A scene 21, on which a pointer is displayed, isplaced foremost. a markup document scene 22 according to the markupdocument is behind the scene 21. An AV scene 23 according to the AV datais behind the markup document scene 22. A background scene 24 generallydisplayed in a single color is behind the AV scene 23.

FIG. 3 shows the structures of files of the DVD 100 of FIG. 1 accordingto an embodiment of the present invention. Referring to FIG. 3, a videodirectory VIDEO_TS includes AV data. An interactive directory DVD_ENAVincludes data for supporting an interactive function, such as a markupdocument. The VIDEO_TS and DVD_ENAV directories are provided in a rootdirectory. The AV data and the reproduction control information (also,known as navigation data) are recorded in the video directory VIDEO_TS.The reproduction control information includes information referred to soas to decode the AV data. The markup document and the scene synthesisinformation are recorded in the interactive directory DVD_ENAV.

More specifically, a file VIDEO_TS.IFO includes header information onthe entire video title. The VIDEO_TS.IFO file is recorded in the videodirectory VIDEO_TS. A file VTS_(—)01_(—)0.IFO includes headerinformation on a first video title. The VTS_(—)01_(—)0.IFO file isrecorded in the video directory VIDEO_TS. Files VTS_(—)01_(—)0.VOB,VTS_(—)01_(—)1.VOB . . . , which includes AV data for constructing thevideo title, are recorded in the video directory VIDEO_TS. A moredetailed structure is disclosed in the DVD-Video standard “DVD-Video forRead Only Memory Disc 1.0,” the disclosure of which is incorporated byreference.

A reproduction control information file DVD_ENAV.IFO includes headerinformation on the entire data needed to support an interactivefunction. The DVD_ENAV.IFO file is recorded in the interactive directoryDVD_ENAV. Only the DVD_ENAV.IFO file may be replaced with various metatags of the markup document which performs a start up function. A markupdocument A.HTM is recorded in the interactive directory DVD_ENAV. Astyle sheet A.CSS, which includes scene synthesis information thereon,is recorded in the interactive directory DVD_ENAV. In addition, markupdocuments B.HTM and C.HTM and style sheets B.CSS and C.CSS correspondingto the markup documents B.HTM and C.HTM are recorded in the interactivedirectory DVD_ENAV. A.PNG which is a graphic file to be inserted anddisplayed in the markup document A.HTM B1.PNG and B2.PNG are graphicfiles to be inserted and displayed in the markup document B.HTM, andC.PNG is a graphic file to be inserted and displayed in the markupdocument C.HTM. Graphics files A.PNG B1.PNG, B2.PNG C.PNG, are recordedin the interactive directory DVD_ENAV. Other markup documents and fileshaving various shapes inserted and displayed therein may be recorded inthe interactive directory DVD_ENAV.

FIG. 4 shows a picture in picture (PIP) mode, as one display modeaccording to the present embodiment. Referring to FIG. 4, in the PIPmode, an AV scene is output as a PIP on a markup document scene. Onlythe markup document scene is physically placed in front of the AV scene,as described with reference to FIG. 2. The PIP mode enables the AV sceneto seem to be output on the markup document scene from a user'sviewpoint. Preferably, the PIP mode is subdivided by the placementlocation and size of the AV scene. In the shown embodiment, the PIP modeis divided into several shapes using PIP-#, such as PIP-1 and PIP-2. Inthe PIP mode, the user can change the location and size of the AV sceneusing a remote controller (not shown). Meanwhile, an example of an XMLcode for constructing the markup document A.HTM shown in FIG. 4 is asfollows.

<?xml version=“1.0”?> <!DOCTYPE html  PUBLIC “-//DVD//DTD XHTML DVD HTML1.0//EN”  “http://www.dvdforum/dvdenav/dvdhtml-1-0.dtd”> <html>  <head>  <title>DVD HTML PIP mode sample</title>   <link rel=“stylesheet”type=“text/css” href=“a.css”>  </head>  <body onload=“dvdvideo.play();”>   <table border=“0” width=“720” height=“480”>    <tr>     <td>     <img src=“a.png” width=“100%” height=“100%”      border=“0”/>    </td>    </tr>   </table>  </body> </html>    A.HTM

It is apparent that the style sheet file A.CSS is linked to the abovesource code using a link tag. An example of a style sheet source code isas follows.

@screen-display { video-placement: pip background-color: #00000000viewport : rect(0px,719px,479px,0px) window: rect(0px,719px,479px,0px)video-viewport: rect(0px,719px,479px,0px) } A.CSS

In the shown embodiment, a cascading style sheet (CSS) uses an@screen_display rule as above, so as to use a display mode between themarkup document scene and the AV scene. Properties such asvideo-placement, which designates a display mode of the AV scene,background-color, which designates a background color of the AV scene,viewport, which designates a trimming area of a scene in which the AVscene is synthesized with the markup document scene, window, whichdesignates a window of the scene in which the AV scene is synthesizedwith the markup document scene, and video-viewport, which designates anarea to increase and reduce a desired portion of the AV scene, aredescribed.

FIG. 5 shows an embedded mode, as one display mode according to thepresent embodiment. Referring to FIG. 5, in the embedded mode, the AVscene is embedded in the markup document through <object . . . >. Thus,the location and size of the AV scene is moved and changed under thecontrol of the markup document. In the embedded mode, the AV scene isembedded and displayed in a display window defined by the markupdocument. An example of an XML code for constructing the markup documentB.HTM shown in FIG. 5 and an example of a style sheet source code are asfollows.

<?xml version=“1.0”?> <!DOCTYPE html  PUBLIC “-//DVD//DTD XHTML DVD HTML1.0//EN”  “http://www.dvdforum/dvdenav/dvdhtml-1-0.dtd”> <html>  <head>  <title>DVD HTML Embeded sample</title>   <link rel=“stylesheet”type=“text/css” href=“b.css”>  </head>  <body onload=“dvdvideo.play():”>   <table border=“0” width=“720” height=“480”>    <tr>     <tdwidth=“277” height=“184” align=“left” valign=“top”>      <objectdata=“dvd:” width=“277” height=“184” border=“0”/>     </td>     <tdwidth=“443” height=“480” align=“left”     valign=“top” rowspan=“2”>     <img src=“b1.png” width=“443” height=“480” border=“0”/>     </td>   </tr>    <tr>     <td width=“277” height=“296”>      <imgsrc=“b2.png” width=“277” height=“296” border=“0”/>     </td>    </tr>  </table>  </body> </html> B.HTM @screen-display { video-placement:embedded background-color: #00000000 viewport :rect(0px,719px,479px,0px) window: rect(0px,719px,479px,0px)video-viewport: rect(0px,719px,479px,0px) } B.CSS

A display window in which the AV scene is to be displayed using anobject tag, is defined in B.HTM. That is, the area of the display windowis determined by properties such as “width” and “height” in the “object”tag. In addition, it is apparent that a style sheet file B.CSS is linkedto B.HTM using a link tag. Here, the B.CSS is a cascading style sheet(CSS) file for the B.HTM. CSS enables a “style” of the markup documentto be described. Alternatively, the style sheet file can be linked toB.HTM using a style tag.

FIG. 6 shows a background mode, as one display mode according to thepresent embodiment. Referring to FIG. 6, in the background mode, themarkup document scene is output on the AV scene. An example of an XMLcode for constructing the markup document C.HTM shown in FIG. 6 and anexample of a style sheet source code are as follows. Similarly, a stylesheet file C.CSS is linked to C.HTM using the link tag.

<?xml version=“1.0”?> <!DOCTYPE html  PUBLIC “-//DVD//DTD XHTML DVD HTML1.0//EN”  “http://www.dvdforum/dvdenav/dvdhtml-1-0.dtd”> <html>  <head>  <title>DVD HTML Background sample</title>   <link rel=“stylesheet”type=“text/css” href=“c.css”>  </head>  <body onload=“dvdvideo.play();”>   <table id=“mainscreen” border=“0” width=“720” height=“480”>   <tr>     <td width=“388” height=“300”>      <p>&nbsp;</p>     </td>    <td width=“322” height=“300”>      <p>&nbsp;</p>     </td>    </tr>   <tr>     <td width=“388” height=“180”>      <p>&nbsp;</p>     </td>    <td width=“388” height=“180”>      <div>       <img src=“c.png”width=“319” height=“100” border=“0”>      </div>    </tr>   </table> </body> </html> C.HTM @screen-display { video-placement: backgroundbackground-color: #00000000 viewport : rect(0px,719px,479px,0px) window:rect(0px,719px,479px,0px) video-viewport: rect(0px,719px,479px,0px) }body {background-color:transparent;} table#mainscreen{background-color:transparent;} C.CSS

Next, the properties and values used as the @screen_display rulerepresenting a display mode between the markup document scene and the AVscene are as follows.

1. Video-Placement:

Video placement designates a display mode of the AV scene. The displaymodes include none, embedded, pip-#, and background representing nothingdisplayed, embedded mode, PIP mode, and background mode, respectively.An initial value is an embedded mode. Here, the background mode isdiscriminated from a background <body background=“dvd:”> using a bodytag. <body background=“dvd:”> represents a background in a windowdefined to output the markup document scene. That is, in the backgroundmode according to the present embodiment, the AV scene is displayed inthe entire scene, but if the background using the body tag isdesignated, the AV scene is displayed only in a predetermined windowscene.

2. Background-Color:

Background color designates a background color of a scene formed of asingle color. A value is <color>, and an initial value may varyaccording to a user agent (UA).

3. Window:

Window designates a window in which a scene where the AV scene issynthesized with the markup document scene, is displayed. A value is<shape>, and an initial value is rect (0%, 100%, 100%, 0%).

4. Viewport:

Viewport designates a trimming area of the scene in which the AV sceneis synthesized with the markup document scene. A value is <shape>, andan initial value is rect (0%, 100%, 100%, 0%).

5. Video-Viewport:

Video-viewport designates an area to increase and reduce a desiredportion of the AV scene. A value is <shape>, and an initial value isrect (0%, 100%, 100%, 0%). Here, the value of the defined <shape> isrectangle (<top>, <right>, <bottom>, <left>).

FIGS. 7A through 7D show reference diagrams more specificallyillustrating a display mode of the AV scene and the markup documentscene according to video-viewport and video-placement. Referring to FIG.7A, if an area a for increasing and reducing from the AV scene isdesignated by video-viewport, when video-placement is a background mode,a trimming area a is displayed in a background scene as shown in FIG.7B, and a markup document scene (not shown) is displayed in the trimmingarea a. When video-placement is a PIP mode, the trimming area a isdisplayed in a designated location as shown in FIG. 7C. Whenvideo-placement is an embedded mode, the trimming area a is embedded ina display window defined by a markup document and is displayed in thedisplay window as shown in FIG. 7D. FIGS. 7A through 7D show an examplein which only a partial area of the AV data is selected, (i.e., the areaof video-viewport is selected as a partial area) such that the partialarea is mapped to the area of window defined by each display mode.

FIGS. 8A through 8C show reference diagrams more specificallyillustrating a display mode of the AV scene and the markup documentscene according to the viewport and the window. In the case of aproperty viewport selected to display a trimming area of contents of thescene in which the AV scene is synthesized with the markup documentscene on a screen of a display, and a property window which designates awindow area so that all or part of a selected document can be displayedin a predetermined scene area on a display screen, values for theviewport and the window are used without change. FIG. 8A shows anexample illustrating that only a partial area b of the scene in whichthe AV scene is synthesized with the markup document scene is selected.Specifically, the area of video-viewport is selected as a partial areasuch that the partial area is mapped to the area of the window definedby each display mode. Thus, the concepts of viewport and window allowpart or all of the scene in which the AV scene is synthesized with themarkup document scene to be increased/reduced.

Referring to FIG. 8A, in the embedded mode in which the AV scene isembedded in the markup document scene and is displayed, a trimming areab of the scene in which the AV scene is synthesized with the markupdocument scene is designated by the viewport, the trimming area b isdisplayed in the window designated by window, as shown in FIG. 8B. Whenthe entire markup document is set to viewport, the trimming area b isdisplayed in the window designated by the window, as shown in FIG. 8C.If a background using a body tag is designated, the entire synthesizedscene is displayed in the window designated by window.

A property variable for designating a display mode, a property variablefor designating a background color of an AV scene, a property variablefor designating a window of a scene in which the AV scene is synthesizedwith a markup document scene, a property variable for designating atrimming area of the scene in which the AV scene is synthesized with themarkup document scene, and a property variable for designating an areato increase and reduce a desired portion of the AV scene are defined inan object for controlling the above-mentioned CSS file.

In addition, the AV scene may be increased/reduced according to a user'sinput using an object source code of an application program interface(API) for a document object model (DOM). The value of the object sourcecode needed in performing this operation can be referred to using ascript language in the markup document.

The following object source code is used to bind“ScreenDisplayProperties” in root elements (i.e., <frameset> and <html>)of the uppermost level.

Interface ScreenDisplayProperties {   attribute ScreenDisplayRulescreenDisplayInfo; }

Here, “ScreenDisplayProperties” are connected to root elements of themarkup document, and the value of “ScreenDisplayProperties” can bereferred to using a script language in the markup document. An exampleof the object source code is as follows.

IDL Definition Interface ScreenDisplayRule {        attribute unsignedshort videoPlacement;        attribute DOMString colorBackground;       attribute DOMString viewport;        attribute DOMString window;       attribute DomSting videoViewport; }; Attributes videoPlacement:It designates a display mode of a DVD-video. That is, it represents that    const unsigned short VIDEO_PLACEMENT_NONE = 0;     const unsignedshort VIDEO_PLACEMENT_EMBEDDED = 1;     const unsigned short    VIDEO_PLACEMENT_BACKGROUND = 2;     const unsigned shortVIDEO_PLACEMENT_PIP = 3; colorBackground: It has the value of <color> asa background color of an AV scene. viewport: It has the value of <shape>as a trimming area of a synthesized scene. window: It has the value of<shape> as a window area on a display to which the trimmed synthesizedscene is to be mapped. videoViewport: It has the value of <shape> as atrimming area of the AV scene.

A static definition using a tag <meta> or <link> as well as a dynamicdefinition using the above object source are also possible.

Meanwhile, a script language included in the markup document is used toincrease/reduce the output AV scene according to a user's input usingthe object source of the API for a DOM described above. The followingexample is an example in which a manufacturer can increase/reduce the AVscene displayed in an embedded state, as shown in FIG. 8.

<?xml version = “1.0” encoding=“UTF-8”?> <!DOCTYPE html PUBLIC“-//DVD//DTD XHTML DVD-HTML 1.0//        EN”“http://www.dvdforum.org/envideo/dtd/dvdhtml-        1.0.dtd”> <html> <head>   <title>Example of Scaling</title>   <script type=“text/ecmascript”>   <--    function zoom(evt)    {    var vdi;    if(evt == 0)    { // evt == 0 : Increase an AV scene to a designated size    vdi = document.documentElement.screenDisplayInfo;    vdi.videoPlacement = 1;     vdi.colorbackground = “black”;    vdi.videoviewport = “rect(10px,709px,469px,10px)”     // In anembedded state, vdi.window is determined by “width” and “height” of atag “Object” in a markup document. That is, rect(0%,100%,100%,0%) isconsistent with sizes of “width” and “height” defined by the tag“Object”.     }    if (evt == 1)    { // evt == 1 : as original      vdi= document.documentElement.screenDisplayInfo;     vdi.videoPlacement =1;     vdi.colorbackground = “black”;      vdi.videoviewport =“rect(0px,719px,479px,0px)”    }    if (evt == 2)    { // evt == 2 :Reduce an AV scene to a designated size     vdi =document.documentElement.screenDisplayInfo;     vdi.videoPlacement = 1;    vdi.colorbackground = “black”;     vdi.videoviewport =“rect(0px,719px,479px,0px)”     vdi.window=“rect(10%,90%,90%,10%)     //Here, a % value is a relative value for “width” and “height” defined bythe tag “Object”.    }    }    -->   </script>  </head>  <bodyonload=“dvdvideo.play( );”>  <table border=“0” width=“720” height=“480”>  <tr>    <td width=“277” height=“184” align=“left” valign=“top”>    <object data=“dvd”: width=“277” height=“184” border =“0”/>    </td>   <td width=“443” height=“480” align=“left” valign=“top”   rowspan=“2”>     <img src=“b1.png” width=“443” height=“480”border=“0”/>    </td>   </tr>   <tr>    <td width=“277” height=“296”>    <input type=“button” value=“Zoom-In” onClick=“zoom(0)”/>     <inputtype=“button” value=“Restore” onClick=“zoom(1)”/>     <inputtype=“button” value=“Zoom-Out” onClick=“zoom(2)”/>    </td>   </tr> </table>  </body> </html>

In this way, the scale of the AV scene can be manipulated through auser's input using the API for a DOM and the script language.

Accordingly, the AV scene and the markup document scene are freelysynthesized with each other according to the above-mentioned embodiment,and the display location of the AV scene can be set by a style sheetlinked to the markup document or embedded in the markup document,thereby allowing a user to enjoy scenes in various shapes.

A reproducing method according to the present invention will bedescribed below based on the above structure. FIG. 9 shows a flowchartillustrating an embodiment of a reproducing method according to thepresent invention. The method shown in FIG. 9 can be implemented usingcomputer software readable by a computer in a reproducing apparatus.Referring to FIG. 9, in operation 910, the reading unit 1 of thereproducing apparatus reads a markup document, which is to be reproducedwith AV data, from the optical disc 100. The presentation engine 3interprets the read markup document in operation 902 and calls a stylesheet file linked to the markup document in operation 903. Subsequently,the presentation engine 3 interprets the style sheet file and providesthe result of interpretation to the AV decoder 2 in operation 904. Morespecifically, the presentation engine 3 reads from the optical disc 100display mode designation information, which designates a displaying modeof the AV scene described in the style sheet file, background colordesignation information, which designates a background color of the AVscene, window designation information, which designates a window inwhich a scene where the AV scene is synthesized with the markup documentand is displayed on the screen of the display, trimming area designationinformation of the synthesized scene, which designates a trimming areaof the scene in which the AV scene is synthesized with the markupdocument, and AV trimming area designation information, which designatesan area to increase and reduce a desired portion of the AV scene. The AVdecoder 2 decodes the AV data according to the style sheet file andoutputs a corresponding AV scene to the blender 4. The presentationengine 3 outputs a command to display the markup document scene and theAV scene, and the markup document scene in which the markup document isreproduced, to the blender 4 according to the description in the stylesheet file. For this purpose, the presentation engine 3 interprets aprogram, which is coded on the basis of an object having propertyvariables for controlling the style sheet file and controls the stylesheet file. The blender 4 blends and outputs the markup document and theAV scene, which are provided from the presentation engine 3 and the AVdecoder 2, respectively.

In operation 905, the AV scene and the markup document scene aredisplayed according to interpreted scene synthesis information. Inoperation 905-1, when the PIP mode is described in the style sheet file,the AV scene is overlapped on the markup document scene and isdisplayed. In operation 905-2, when the embedded mode is described inthe style sheet file, the AV scene is embedded in the markup documentscene and is displayed. In operation 905-3, when the background mode isdescribed in the style sheet file, the markup document scene isoverlapped on the AV scene and is displayed.

FIG. 10 is a flowchart specifically illustrating operations subsequentto operation 903 of FIG. 9. Referring to FIG. 10, the presentationengine 3 interprets the CSS file in the markup document or the link tag,and calls the CSS file in operation 1001. The presentation engine 3interprets the called CSS file in operation 1002, and reads the displaymode designation information and the AV trimming area designationinformation, which are described in the CSS file, in operation 1003. Theblender 4 blends and outputs the command and the markup document sceneprovided from the presentation engine 3 and the AV scene provided fromthe AV decoder 2. The markup document scene and the AV scene aredisplayed according to the display mode described in the CSS file inoperation 1004. In the case of a none mode, the AV scene is notdisplayed in operation 1004-1. Otherwise, one of the PIP mode (operation1004-2), the background mode (operation 1004-3), and the embedded mode(operation 1004-4) may be displayed.

FIG. 11 is a flowchart illustrating a preferred embodiment of arecording method according to the present invention. The method shown inFIG. 11 can be implemented by a computer program readable by a computerin a recording apparatus. Referring to FIG. 11, the recording apparatusrecords the AV data on an information storage medium (operation 1101),records the markup document that is to be reproduced with the AV data onthe information storage medium (operation 1102), and records theabove-mentioned scene synthesis information in the style sheet filelinked to or embedded in the markup document (operation 1103). Inoperation 1103, an object having property variables for controlling thestyle sheet file in the markup document and a program for controllingthe style sheet file on the basis of the object are recorded on theinformation storage medium.

Until now, there have been described embodiments in which the scenewhere the markup scene is synthesized with the AV scene is beingincreased/reduced using the properties window and viewport of the scenesynthesis information, and part of the AV scene is increased/reducedusing the property video-viewport such that the AV data and the markupdocument are displayed in various ways in the interactive mode.

Hereinafter, an embodiment of a method for displaying the AV data andthe markup document in various ways in the interactive mode according toa resolution and an aspect ratio (screen ratio) set by the user or inthe reproducing apparatus using the properties window and the viewportof the above-mentioned scene synthesis information will be described.When the markup document that is manufactured to have a fixed screenratio in the present invention is displayed on a display having adifferent aspect ratio, a scene distortion phenomenon may occur by whichpart of data, such as text or graphics to be displayed on a displayscreen, is incorrectly displayed. Thus, in the present invention, thedistortion of the scene is minimized to correspond to a screen mode(aspect ratio, resolution, and video output method) set by the user oralready set in the reproducing apparatus by changing the interactivecontents manufactured at one fixed screen ratio to have various screenratios using the properties window and viewport.

First, methods for displaying interactive contents manufactured using amarkup language in several displays having different screen aspectratios while minimizing distortion of the interactive contents will bedescribed with reference to FIGS. 12A through 12F. To meet theconvenience of explanation, the ratio of pixel size in all cases is setto 1×1.

According to one displaying method, a manufacturer prepares respectivemarkup documents and respective AV data by considering several screenaspect ratios so as to correspond to a display having different aspectratios. In order to display interactive contents that are not distortedin the display having different aspect ratios as shown by FIG. 12A andFIG. 12B, the manufacturer prepares respective markup documents byconsidering different aspect ratios of the display as shown by FIG. 12Cand FIG. 12D, and respective AV data (i.e., AV contents of DVD-videoformat) by considering different aspect ratios of the display as shownby FIG. 12E and FIG. 12F. Contents of FIGS. 12C through 12E, in which AVdata for a 4×3 screen size is synthesized with a markup document for the4×3 screen size, can be displayed on the screen of a display having the4×3 screen size as shown by FIG. 12A. Contents of FIGS. 12D through 12F,in which AV data for the 16×9 screen size is synthesized with a markupdocument for the 16×9 screen size, can be displayed on the screen of adisplay having a 16×9 screen size as shown by FIG. 12B. This allows adisplay of the contents which the manufacturer wants without performingany special operation.

According to another displaying method, the manufacturer prepares therespective markup documents by considering aspect ratios of a display,and the AV data corresponds to a display having different aspect ratiosin the following way when contents having a fixed aspect ratio aremanufactured.

When only the screens shown in FIGS. 12C, 12D, and 12E are manufacturedand when displaying on a display having the 4×3 screen size, thecontents of FIGS. 12C through 12E, in which the AV data for the 4×3screen size is synthesized with the markup document for the 4×3 screensize, can be displayed in a scene 1 shown in FIG. 12A. This allows adisplay of the contents which the manufacturer wants, without performingany special operation.

When displaying on a display having the 16×9 screen size, the AV datafor the 4×3 screen size shown in FIG. 12E is embedded in the markupdocument for the 16×9 screen size shown in FIG. 12D, which includesright and left blanks without expansion. Only the right and left blanksmay be eliminated by setting the size of an object tag of the markupdocument for the 16×9 screen size so that the AV data for the 4×3 screensize can be embedded in the markup document for the 16×9 screen size.The contents of FIGS. 12D and 12E can be displayed in a scene 2 shown inFIG. 12B as contents which the manufacturer wants without performing anyspecial operation.

When only the screens shown in FIGS. 12C, 12D and 12F are manufactured,and when displaying on a display having the 4×3 screen size, the AV data6 for the 16×9 screen size shown in FIG. 12F is converted into a shapeof a 4×3 normal scene, 4×3 letter box scene, or 4×3 pan-and-scan sceneand then is embedded in a markup document 3 for the 4×3 screen sizeshown in FIG. 12C. The manufactured contents of FIGS. 12C through 12Fcan be displayed in a scene 1 shown in FIG. 12A as contents which themanufacturer wants without performing any special operation.

Here, a full screen scene is referred to as a standard scene and ismanufactured and reproduced at an aspect ratio of 4×3 (1.33:1). A fullnormal scene is displayed on a display having the 4×3 screen size. Ablack band appears at both ends of a screen of a display having the 16×9screen size. If a user views a full scene on a display screen for 16×9(wide mode of FIG. 13A), the resulting picture appears to behorizontally spread. If the user views the scene in a zoom mode, theupper and lower portions of the scene are cut off. In the two cases, thepicture is simply increased and thus resolution is lower.

Pan-and-scan is a picture manufactured by cutting both sides of apicture manufactured in a wide scene format (16×9), and selecting only amiddle portion of a scene corresponding to an aspect ratio of 4×3(1.33:1) as shown in FIG. 13B, and a method for reproducing pan-and-scanis the same as that of a full screen.

A letter box scene has an advantage that the user can appreciate a sceneas seen in a movie theater, but has a disadvantage that the size of thescene is reduced as shown in FIG. 13C. Thus, in a pan-and-scan method,both ends of an unimportant scene are cut off, and a picture is filledin a 4×3 scene rather than a scene is reduced and displayed. There maybe a difference in picture beauty of the 4×3 pan-and-scan scenedepending on an editor's skill.

Letter box is a picture manufactured by inserting a black band in upperand lower portions of a scene and reducing the scene so that the usercan effectively view a picture manufactured in a wide scene format(16×9) in a normal display (screen ratio 4×3). The upper and lower blackbands of the picture are referred to as “Matte.”

When displaying on a display having the 16×9 screen size, the contentsof FIGS. 12D and 12F, in which AV data for the 16×9 screen size issynthesized with a markup document for the 16×9 screen size, can bedisplayed in a scene 2 as shown in FIG. 12B as contents which themanufacturer wants, without performing any special operation.

According to a further displaying method, the manufacturer prepares therespective AV data by considering aspect ratios of a display, and amarkup document corresponds to a display having different aspect ratiosin the following way when contents having a fixed aspect ratio aremanufactured.

When only the screens shown in FIGS. 12C, 12E and 12F are manufactured,and when displaying on a display having the 4×3 screen size, thecontents of FIGS. 12C and 12E, in which the AV data for the 4×3 screensize is synthesized with a markup document for the 4×3 screen size, canbe displayed in a scene 1 shown in FIG. 12A as contents which themanufacturer wants without performing any special operation.

When displaying on a display having the 16×9 screen size, the AV data 6shown in FIG. 12F for the 16×9 screen size is converted into a shape ofa 4×3 normal scene, 4×3 letter box scene, or 4×3 pan-and-scan scene andthen is embedded in a markup document 3 shown in FIG. 12C for a 4×3screen size. The manufactured contents of screens 3+6 shown in FIGS. 12Cand 12F can be displayed to include blanks on the right and left sidesof a scene 2 shown in FIG. 12B through middle alignment.

When only the screens shown in FIGS. 12D, 12E and 12F are manufacturedand when displaying on a display having the 4×3 screen size, the AV data5 for the 4×3 screen size shown in FIG. 12E is embedded in a markupdocument 4 shown in FIG. 12D for the 16×9 screen size to include rightand left blanks without expansion. The resolution of the manufacturedcontents of FIGS. 12D and 12E is, for example, 854×480, and thus only animportant screen portion can be displayed in a scene 1 of a displayhaving a 4×3 screen size screen size shown in FIG. 12A through a conceptof a “hot area” and an API with respect to aspect ratio conversion.

When displaying on a display having a 16×9 screen size, the contents ofFIGS. 12D and 12F, in which AV data for the 16×9 screen size issynthesized with a markup document for the 16×9 screen size can bedisplayed in a scene 2 shown in FIG. 12B as the manufacturer wantswithout performing any special operation.

According to an additional displaying method, when each of AV data and amarkup document is manufactured at one aspect ratio, the AV data and themarkup document correspond to a display having different aspect ratiosin the following way.

When only the screens 3, 5 shown in FIGS. 12C and 12E are manufactured,and when displaying on a display having the 4×3 screen size, thecontents of FIGS. 12C and 12E in which AV data for the 4×3 screen sizeis synthesized with a markup document for the 4×3 screen size, can bedisplayed in the scene 1 shown in FIG. 12A as contents which themanufacturer wants without performing any special operation.

When displaying on a display having the 16×9 screen size, through themiddle alignment of the entire contents of FIGS. 12C and 12E in which AVdata for the 4×3 screen size is synthesized with a markup document forthe 4×3 screen size, the contents of FIGS. 12C and 12E can be displayedto include blanks on the right and left sides of a screen of a displayhaving the 16×9 screen size.

When only screens 4 and 6 shown in FIGS. 12D and 12F are manufacturedand when displaying on a display having the 4×3 screen size, theresolution of the manufactured contents of FIGS. 12D and 12F, in whichthe AV data for the 16×9 screen size is synthesized with a markupdocument for the 16×9 screen size, is 854×480. Thus only an importantscreen portion can be displayed in a scene 1 shown in FIG. 12A of adisplay having the 4×3 screen size through a concept of “hot area” andan API with respect to aspect ratio conversion. In this case,preferably, the pan-and-scan or letter box is applied to the video modeother than the interactive mode.

When displaying on a display having the 16×9 screen size, the contentsof FIGS. 12D and 12F, in which AV data is synthesized with a markupdocument can be displayed in a scene 2 shown in FIG. 12B as themanufacturer wants without performing any special operation.

Here, “hot area” and the API with respect to the aspect ratio conversionwill be described in greater detail. When interactive contentsmanufactured for use in the 16×9 screen size (resolution of 854×480) aredisplayed on a display having the 4×3 screen size (resolution of640×480), only a 640×480 area of the entire area of the interactivecontents is displayed on the display having a 4×3 screen size. Theremaining 214×480 area is not displayed on the display having a 4×3screen size. Therefore, the manufacturer includes contents which shouldbe displayed on a 640×480 area. As referred to in the present invention,the displayed maximum area is referred to as “hot area” regardless of anaspect ratio of a display. The 640×480 area is an area which can bedisplayed regardless of an aspect ratio of a display during initiallayout, and includes unimportant contents or does not include anycontents in the remaining area. In order to display a markup documentmanufactured by the concept of “hot area” on a display having the 4×3screen size and in order to display an AV scene and a markup documentscene in various ways, the interactive contents are displayed using theabove-mentioned properties “viewport” and “window” used in the objectsource code of the API for a DOM, and descriptions thereof will bedescribed later.

Hereinafter, a simple example in which interactive contents for the 16×9screen size are displayed on a display having the 4×3 screen sizeregardless of an aspect ratio of a display, will be described withreference to FIG. 14. The manufacturer creates a markup document usingthe concept of “hot area” so as to display a scene that is not distortedregardless of the various aspect ratios of the display. That is, in adocument space of a markup document shown in FIG. 14, the entire markupdocument is manufactured for 854×480 is to be displayed on a displaywith the 16×9 screen size. The contents of a 640×480 “hot area” is to bedisplayed on a display having the 4×3 screen size. Here, the size of the“hot area” is not fixed but is exemplified by a 640×480 size as a sizefor minimizing distortion, and its location is also not fixed.

In addition, in the markup document space manufactured for the 16×9screen size, the manufacturer uses the property viewport so as to selectthe “hot area” that is set not to be distorted and is to be displayed onthe display having the 4×3 screen size, maps to a designated are of ascene using the property window so as to display the selected “hot area”on the display having the 4×3 screen size.

FIGS. 15A and 15B show variations in coordinate systems needed inmapping the area selected using viewport to the area designated usingwindow.

$\begin{matrix}{X_{window} = {\frac{\left( {X_{document} - X_{viewport\_ origin}} \right)}{{Width}_{viewport}} \times {Width}_{window}}} & (1) \\{Y_{window} = {\frac{\left( {Y_{document} - Y_{viewport\_ origin}} \right)}{{Width}_{viewport}} \times {Height}_{window}}} & (2)\end{matrix}$

The above Equations 1 and 2 show that one point (X_(document),Y_(document)) of a document coordinate system is mapped to one point(X_(Window), Y_(window)) of a corresponding window coordinate system.

X _(screen) =X _(window) +X _(window) _(—) _(origin)  (3)

Y _(screen) =Y _(window) +Y _(window) _(—) _(origin)  (4)

The above Equations 3 and 4 show that one point (X_(Window), Y_(Window))of a window coordinate system obtained by Equations 1 and 2 is mapped toone point (X_(screen), Y_(screen)) of a corresponding screen coordinatesystem of a display. The above Equations 1 through 4 are based on amarkup document, but if a lower subscript “document” is changed into“video,” the definition of the AV data is made.

An example of an optimum table showing the size of each area through theabove-mentioned displaying methods at a pixel size ratio of 1×1 toeasily recognize a document area, a viewport area, a window area, and ascreen area and the size of an area through other available displayingmethods is as follows.

Case Document area Viewport Area Window area Screen Area Wheninteractive contents 640 × 480 640 × 480 640 × 480 640 × 480manufactured for 640 × 480 are displayed on a 640 × 480 display Wheninteractive contents 640 × 480 640 × 480 640 × 480 854 × 480manufactured for 640 × 480 are displayed on a 854 × 480 display Wheninteractive contents 640 × 480 640 × 480 854 × 480 854 × 480manufactured for 640 × 480 are displayed on a 854 × 480 display Wheninteractive contents 854 × 480 854 × 480 640 × 480 640 × 480manufactured for 854 × 480 are displayed on a 640 × 480 display Wheninteractive contents 854 × 480 854 × 480 640 × 480 640 × 480manufactured for 854 × 480 are displayed on a 640 × 480 display Wheninteractive contents 854 × 480 640 × 480 640 × 480 640 × 480manufactured for 854 × 480 are displayed on a 640 × 480 display Wheninteractive contents 854 X 480 854 × 480 854 × 480 854 × 480manufactured for 854 × 480 are displayed on a 640 × 480 display

Meanwhile, reproducing methods according to an aspect ratio are largelyclassified by a static method, which uses the CSS, and a dynamic method,which uses an API for a DOM. When interactive contents are initiallydisplayed in a scene, the interactive contents are displayed on adisplay through a static method using a default style sheet in apresentation engine, or using a CSS defined by link and style tags in amarkup document. However, when an aspect ratio is changed by a user'sinput during reproduction, the aspect ratio of an output screen can bedynamically changed by adding an aspect ratio conversion function usinga script language to the markup document using the API for a DOM.

Hereinafter, a static method using the @screen-display rule will bedescribed. A property screen-display type is added to the@screen-display rule according to another embodiment of the presentinvention.

1. Screen-Display Type:

Screen-display type designates the aspect ratio of a scene in which anAV scene is synthesized with a markup document.

4×3N: If a user sets a screen output to a 4×3 normal shape

4×3L: If a user sets a screen output to a 4×3 letter box shape

4×3P: If a user sets a screen output to a 4×3 pan-and-scan shape

16×9W: If a user sets a screen output to a 16×9 wide shape

2. Video-Placement:

Video-placement designates a display mode of the AV scene. The displaymodes include none, embedded, pip-#, and background representing nothingdisplayed, embedded mode, PIP mode, and background mode, respectively.An initial value is an embedded mode.

3. Video-Viewport:

Video-viewport designates an area to increase and reduce a desiredportion of the AV scene. A value is <shape>, and an initial value isrect (0%, 100%, 100%, 0%). Here, the value of the defined <shape> isrectangle (<top>, <right>, <bottom>, <left>).

4. Background-Color:

Background-color designates a background color of a scene formed of asingle color. A value is <color>, and an initial value may varyaccording to a user agent (UA).

5. Window:

Window designates a window in which a scene where the AV scene issynthesized with the markup document scene, is displayed. A value is<shape>, and an initial value is rect (0%, 100%, 100%, 0%).

6. Viewport:

Viewport designates a trimming area of the scene in which the AV sceneis synthesized with the markup document scene. A value is <shape>, andan initial value is rect (0%, 100%, 100%, 0%).

@screen-display 4x3N { background-color : #000000 viewport :(0px,629px,479px,90px) window : (0px,719px,479px,0px) video-viewport :(0px,719px,479px,0px) } @screen-display 4x3L { background-color :#000000 viewport : (0px,719px,479px,0px) window : (60px,719px,419px,0px)video-viewport : (0px,719px,479px,0px) } @screen-display 4x3P {background-color : #000000 viewport : (0px,629px,479px,90px) window :(0px,719px,479px,0px) video-viewport : (0px,629px,479px,90px) }@screen-display 16x9W { background-color : #000000 viewport :(0px,719px,479px,0px) window : (0px,719px,479px,0px) video-viewport :(0px,719px,479px,0px) }

Since the default style sheet is differently set in each reproducingapparatus, a scene cannot be usually displayed as the manufacturerwants. Thus, according to an aspect of the invention, the manufactureruses another mechanism, such as an additional CSS, in the markupdocument and attaches the CSS to the document so that the user caneffectively display the AV data (DVD-video) and the markup documentmanufactured at a fixed aspect ratio, even at an aspect ratio set by theuser. The following example shows that the manufacturer makes the CSS inthe markup document so that AV data (DVD-video) for the 16×9 screen sizeand a markup document for the 4×3 screen size can be effectivelydisplayed in a “background mode.” The CSS may be made using a “style”tag, as shown the following example, and may be used through externalreference using a “link” tag.

<!DOCTYPE html PUBLIC “-//DVD//DTD XHTML DVD-HTML 1.0//          EN”“http://www.dvdforum.org/enav/dtd/dvdhtml-1-          0.dtd”> <html> <head>   <title>Example of aspect ratio change</title>   <styletype=“text/css”>    @screen-display 4x3N    {      video-placement :background      background-color : #000000      viewport :(0px,719px,479px,0px)      window : (0px,719px,479px,0px)     video-viewport : (0px,629px,479px,90px)//If the entire area isselected using a viewport area, DVD-video displayed as a backgroundseems to be slim. Thus, in order to solve this problem, the manufacturerjust elects pan & scan. A selection area may be varied by themanufacturer.     }    @screen-display 4x3L    {     video-placement :background     background-color : #000000     viewport :(0px,719px,479px,0px)     window : (60px,719px,419px,0px)    video-viewport : (0px,719px,479px,0px)    }    @screen-display 4x3P    {      video-placement : background      background-color : #000000     viewport : (0px,719px,479px,0px)      window :(0px,719px,479px,0px)      video-viewport : (0px,629px,479px,90px) // Anarea formed by cutting the right and left sides of DVD-video will beselected.      }    @screen-display 16x9W    {     video-placement :background     background-color : #000000     viewport :(0px,719px,479px,0px)     window : (0px,629px,479px,90px) // In order toprevent a markup document from distorting, a window area is reduced.    video-viewport : (0px,719px,479px,0px)    }   </style>  </head> <body id=“bodyNode”>............................................................................................................. </body> </html>

In this way, documents initially displayed by statically applying theCSS are displayed in a scene through the structure of processing shownin the following table in the presentation engine 3. A correspondingpage of a document of which aspect ratio is changed during reproductionshould be reloaded to guarantee a correctly displayed scene. If thecorresponding page of the document is not reloaded and is displayed inthe scene, the scene of the markup document may be distorted, or themarkup document may be not mapped to the AV data.

If (Initial Display aspect ratio==4x3 && (no_video == 1 current display== nomal)) {  apply@screen-display 4x3N else if (Initial Display aspectratio==4x3 && current display == 4x3P) {  apply@screen-display 4x3P elseif (Initial Display aspect ratio==4x3 && current display == 4x3L) { apply@screen-display 4x3L else if (Initial Display aspect ratio==16x9){  apply@screen-display 16x9W }

In the above algorithm in the presentation engine 3, “Initial Displayaspect ratio” corresponds to Initial Display aspect ratio of a systemparameter SPRM(14) defined in DVD Specifications for Read-Only Disc/Part3. “Initial Display aspect ratio” is a parameter obtained by initiallysetting an aspect ratio which the user prefers and has the values of twotypes of screen sizes, such as the 4×3 and 16×9 screen sizes as shown inthe above algorithm.

A “no-video” element indicates whether there is AV data (i.e.,DVD-video) in a markup document loaded initially. In the shown example,if the value of “no_video” element is “0,” it is determined that theDVD-video is included in the markup document. If the value of the“no_video” element is “1,” it is determined that the DVD-video is notincluded in the markup document. “current display” is a parameterrepresenting an output mode (normal, 4×3P, and 4×3L) of video in thecurrent domain and is defined in SPRM(14) of DVD Specifications forRead-Only Disc/Part 3.

As above, the static method for displaying interactive contentsaccording to a screen aspect ratio using the default style sheet or theCSS attached to the document by the manufacturer has been described.

The following object source code is used to bind“ScreenDisplayProperties” in root elements (i.e., <frameset> and <html>)of the uppermost level.

Interface ScreenDisplayProperties {     attribute ScreenDisplayRulescreenDisplayInfo; };

ScreenDisplayProperties are connected to the root elements of the markupdocument. The value of ScreenDisplayProperties can be referred to usinga script language in the markup document.

IDL Definition   Interface ScreeenDisplayRule   {    readonly attributeunsigned short screenDisplayMode;         attribute unsigned shortvideoPlacement;         attribute DOMString colorBackground;        attribute DOMString viewport;         attribute DOMStringwindow;         attribute DOMString videoviewport;   }; AttributesscreenDisplayMode: Aspect ratio of an output screen set by the user  const unsigned short   SCREEN_DISPLAY_MODE_4x3NORMAL = 0;   constunsigned short   SCREEN_DISPLAY_MODE_4x3LETTERBOX = 1;   const unsignedshort   SCREEN_DISPLAY_MODE_4x3PAN&SCAN = 2;   const unsigned short  SCREEN_DISPLAY_MODE_16x9WIDE = 3; videoPlacement: It designates adisplay mode of the AV scene   const unsigned shortVIDEO_PLACEMENT_NONE = 0;   const unsigned shortVIDEO_PLACEMENT_EMBEDDED = 1;   const unsigned short  VIDEO_PLACEMENT_BACKGROUND = 2;   const unsigned shortVIDEO_PLACEMENT_PIP = 3; colorBackground: It has the value of <color> asa background color of an AV scene. viewport: It has the value of <shape>as a trimming area of a markup document. window: It has the value of<shape> as a window area on a display to which the trimmed markupdocument is to be mapped. videoviewport: It has the value of <shape> asa trimming area of AV data.

The above-mentioned dynamic definition using the object source of theAPI for the DOM is implemented by a script language included in themarkup document, as shown in the following example. The example is madeby the manufacturer by considering event handling according to user'saspect ratio conversion of AV data for the 16×9 screen size (such asDVD-video) and a markup document for the 16×9 screen size which are tobe displayed in an embedded mode.

<?xml version “1.0” encoding=“UTF-8”?> <!DOCTYPE html PUBLIC“-//DVD//DTD XHTML DVD-HTML 1.0//EN”       http://www.dvdforum.org/envideo/dtd/dvdhtml-1-0.dtd”> <html>  <head>    <title>Example of aspect ratio change</title>    <scripttype=“text/javascript”>    <--      function eventHandler(evt)      {     var vdi;      if (evt.index == SCREEN_DISPLAY_MODE_CHANGE &&(evt.param1 == 0))      { // param1 == 0 : 4x3N       vdi =document.documentElement.screenDisplayInfo;       vdi.videoPlacement =1;       vdi.colorBackground = “black”;       vdi.viewport =“(0px,629px,479px,90px)”; // An area formed by cutting right and leftsides of a markup document is selected. In this case, it is mostpreferable that the selected area is consistent with a “hot area”.       vdi.window = “(0px,719px,479px,0px)”;       vdi.videoviewport =“(0px,719px,479px,0px)”      }      if (evt.index ==SCREEN_DISPLAY_MODE_CHANGE && (evt.param1 == 1))      { // param1 == 1 :4x3L       vdi = document.documentElement.screenDisplayInfo;      vdi.videoPlacement = 1;       vdi.colorBackground = “black”;      vdi.viewport = “(0px,629px,479px,90px)”;       vdi.window =“(0px,719px,479px,0px)”;       vdi.videoviewport =“(0px,719px,479px,0px)” // Even though the entire DVD-video picture isselected, in a 4 x 3 letter box mode, it seems that “Matte” is added tothe upper and lower portions of a scene.      }      if (evt.index ==SCREEN_DISPLAY_MODE_CHANGE && (evt.param1 == 2))     { // param1 == 2 :4x3P       vdi = document.documentElement.screenDisplayInfo;      vdi.videoPlacement = 1;       vdi.colorBackground = “black”;      vdi.viewport = “(0px,629px,479px,90px)”;       vdi.window =“(0px,719px,479px,0px)”;       vdi.videoviewport =“(0px,629px,479px,90px)” // Part of a scene formed by cutting right andleft sides of the DVD-video picture will be selected.      }      if(evt.index == SCREEN_DISPLAY_MODE_CHANGE && (evt.param1 == 3))      { //param1 == 3 : 16x9W       vdi =document.documentElement.screenDisplayInfo;       vdi.videoPlacement =1;       vdi.colorBackground = “black”;       vdi.viewport =“(0px,719px,479px,0px)”;       vdi.window = “(0px,719px,479px,0px)”;     }      }    −−>   </script>   <script type=“text/javascript”>   <−−   function setupEventHandler( )    {    //eventHandler is registered tobodyNode and Interactive Contents    //SCREEN_DISPLAY_MODE_CHANGE == 500   bodyNode.addEventListener(“dvdvideo”,eventHandler,true);dvdVideo.SubscribeToEvent(SCREEN_DISPLAY_MODE_CHANGE,true);}   −−>   </script>   </head>   <body id=“bodyNode”onload=“setupEventHandler()”>  ..................................................................................................  </body> </html>

The markup document is displayed in a scene through initial staticdefinition, and then due to the occurrence of an event according to auser's aspect ratio conversion key (or button) input,“vdi.screenDisplayMode” information is read, thereby reconstituting theaspect ratio of the scene using a script language included in the abovemarkup document.

FIG. 16 is a flowchart of another embodiment of a reproducing methodaccording to the present invention. Referring to FIG. 16, by using theabove-mentioned static and dynamic definitions, the markup documentscene is displayed according to a screen mode (aspect ratio, resolution,and video output method) set by the user or set in the reproducingapparatus. The screen mode can be changed even during reproductionthrough a user's input. A viewport value and a window value of themarkup document applied in this case can be applied to a next markupdocument as it is if these are not changed in a next markup document.

In operation 1601, the presentation engine 3 reads the screen mode(aspect ratio, resolution, and video output method) set in thereproducing apparatus or the screen mode set by the user. Here, a videooutput method is for a 16×9 video to be output in a 4×3 letter box or4×3 pan-and-scan, and 16×9 wide mode, which can be displayed withoutscene distortion.

When a display is set to the 4×3 size, the AV decoder 2 converts an AVstream into a letter box or pan-and-scan shape and outputs the convertedAV stream. When the display is set to the 16×9 size, the AV decoder 2outputs the AV stream in the 16×9 size without conversion. This isbecause the AV stream is generally encoded in the 16×9 size in the DVDreproducing apparatus. However, it is preferable that the output isperformed only when the AV stream is reproduced in a video mode otherthan a conventional interactive mode, and in the interactive mode, theAV stream is always output in the 16×9 size.

In operation 1602, a default style sheet in the presentation engine 3 isselected based on the set screen mode, and properties such as viewport,window, and video viewport, which are defined in the correspondingdefault style sheet, are determined. The presentation engine 3interprets the markup document read by the reading unit 1 and checks thestyle sheet linked to or embedded in the markup document. In operation1603, if there is no style sheet provided by the manufacturer in themarkup document, the presentation engine 3 outputs the markup documentto a scene using the properties such as viewport, window, and videoviewport, which are defined in the default style sheet selected based onthe set screen mode. If there is a style sheet provided by themanufacturer in the markup document, the presentation engine 3 outputsthe markup document to the scene using the properties such as viewport,window, and video viewport according to the @screen-display which isdefined in the corresponding style sheet.

In operation 1604, it is determined whether the screen mode according toa user's aspect ratio conversion key (or button) is changed. Inoperation 1605, if the screen mode is changed by the user, thepresentation engine 3 informs the corresponding markup document of anaspect ratio conversion event ASPECT_RATIO_CHANGE, executes a scriptcaused by the event, interprets a screen display property variablecorresponding to the changed screen mode using ScreenDisplayPropertiesin the presentation engine 3, changes a screen output state of themarkup document based on the interpreted information, and outputs a newmarkup document to the scene. In operation 1606, if the screen mode isnot changed in operation 1604, it is determined whether the output ofthe markup document is terminated.

In the case of the markup document, a mode such as a letter box orpan-and-scan mode, has not been defined. Thus, if the markup documentmanufactured for a 16×9 size is displayed on a display having a 4×3size, the method for effectively displaying the markup document usingthe concept of a “hot area,” properties such as “viewport” and “window,”have been described so as to prevent scene distortion where contentsseem to be slim in another embodiment of the above-mentioned reproducingmethod according to the present invention.

In another embodiment of the reproducing method according to the presentinvention, a method is used that is highly effective in synthesizing anAV scene and a markup document, which are manufactured at a fixed aspectratio (screen ratio) with each other without scene distortion, so thatthe user can enjoy a display state which is close to manufacturer'sintention. Simultaneously, using the markup document having a fixedaspect ratio (screen ratio), a disc space can be more effectively usedby avoiding repeated recording of interactive contents. When a storagemedium which includes AV data (DVD-video), which is manufactured to a16×9 size, and a markup document, which is manufactured to a 4×3 size,is to be displayed on a display having the 16×9 size using a reproducingapparatus, displaying methods according to displaying modes (embeddedmode, background mode, and PIP mode) will be described with reference toFIGS. 17A through 17D.

FIG. 17B shows a case where AV data for the 16×9 size as shown in FIG.17A is synthesized with a markup document in an “embedded mode.” In theembedded mode, the AV data is embedded by “object” elements as shown inFIG. 17B as will be described. If the manufacturer sets “width” and“height” of the “object” tag in the markup document so that the AV datafor the 16×9 screen is expressed as it is, the entire synthesized sceneis selected as a viewport area and is not expanded so that there is noscene distortion in a display having the 16×9 size. Further, an areaexcluding right and left blanks is selected as a window area, and thesynthesized scene is displayed, thereby the scene can be effectivelydisplayed. However, if the manufacturer sets “width” and “height” of the“object” tag used to embed the AV data for the 16×9 size to a 4×3 screenratio, the AV data will be embedded in the markup document in a normalshape, letter box or pan-and-scan shape, and the synthesized scene willbe displayed on the display having a 16×9 screen size without expansion.In this case, even though the AV data is manufactured to a 16×9 size,the AV data is embedded in the display having a 16×9 screen size at the4×3 screen ratio, and thus this case is not considered as preferable.

FIG. 17C shows a case where the AV data is synthesized with the markupdocument in a “background” mode using the property video-placement inthe @screen-display of a cascading style sheet (CSS). In theabove-mentioned another embodiment of the reproducing method accordingto the present invention, the viewport area has both the AV data and themarkup document, but the window area has been defined only in thesynthesized scene thereof. Thus, if the synthesized scene in the“background” mode is displayed on the display having the 16×9 size, theAV data displayed as the background is just displayed at the same 4×3screen ratio as an aspect ratio of the markup document.

FIG. 17D shows a case where the AV data is synthesized with the markupdocument in a “PIP” mode using the property video-placement in the@screen-display of a cascading style sheet (CSS). This case is similarto the shape of the embedded mode, and an original markup document willmake a total scene for the 4×3 size without considering the AV data. Themarkup document is displayed in a scene, and then the AV data under agraphic plane will be displayed in a transparent handling area set foreach PIP-# in the presentation engine 3. In this case, the reduced AVdata under the transparent handling area appears in a predetermined areafor each PIP-#, and thus adaptability is lower.

Since the area set to the viewport in a scene in which the markupdocument is synthesized with the AV data is mapped to window fordesignating an area so that corresponding interactive contents aredisplayed on the display, in particular, in the “background” mode amongvarious reproduction modes, the scene cannot be produced as themanufacturer wants. That is, FIG. 18A shows a case where the AV data forthe 16×9 size is synthesized with a markup document for the 4×3 size ina letter box shape in the “background” mode and is displayed on adisplay having a 16×9 aspect ratio. In addition, FIG. 18B shows a casewhere the AV data for the 16×9 size is synthesized with the markupdocument for the 4×3 size in a pan-and-scan shape in the “background”mode and is displayed on the display having the 16×9 aspect ratio. Sinceonly the window area of the synthesized scene is defined when displayingthe scene even though the manufacturer encodes the AV data to a 16×9size, in order to prevent the AV data from displaying in the letter boxor pan-and-scan shape as shown in FIGS. 18A and 18B, in anotherembodiment of the present invention, a scene can be displayed in themost appropriate shape according to an aspect ratio of a display ordisplay modes (embedded mode, background mode, and PIP mode) by definingthe viewport and window properties only for a markup document and theviewport and window properties only for AV data, respectively.

In FIGS. 19A through 19F, assuming that the markup documents consideringdifferent aspect ratios of displays 3 and 4 shown in FIGS. 19C and 19D,and AV data (i.e., AV contents of DVD-video format) consideringdifferent aspect ratios of displays 5 and 6 shown in FIGS. 19E and 19Fexist in displays 1 and 2 shown in FIGS. 19A and 19B for 4×3 and 16×9screen sizes. A resolution of the displays is 720×480 having the samepixel number, as shown in FIGS. 20A and 20B, in the case of NTSC. Only,in a 16×9 aspect ratio, the ratio of width to length of a pixel is1.78:1, as shown in FIG. 20A, and in a 4×3 aspect ratio, the ratio ofwidth to length of a pixel is 1.33:1 as shown in FIG. 20B.

In this way, if a display is a television (TV), the aspect ratio of ascene pixel varies according to the type of TV, and thus it is difficultto understand variations in a scene. Thus, for the convenience ofexplanation, a conversion equation with regard to each case of 1.78×1,1.33×1, and 1×1 screen ratios will be described with reference to FIG.21. Only, the length of a unit pixel is the same. Namely, in all cases,there are no variations in height.

Conversion 1: The resolution of 720×480 having a 16×9 pixel aspect ratiois converted into a shape having a 1×1 unit pixel aspect ratio. Totalhorizontal resolution=normalization (when the length ratio of the unitpixel is 1, a width ratio, total vertical resolution)=when the lengthratio of the unit pixel is 1, a width ratio×total horizontalresolution=1.78×480=854.

Therefore, the resolution of a 720×480 size having a 16×9 pixel aspectratio is consistent with the resolution of a 854×480 size having a 1×1unit pixel aspect ratio. That is, when converting into a shape usingconversion 1, the following Equation is formed:

${X\left( {1.78\; \text{:}\; 1} \right)} = {\frac{720}{854}{X\left( {1\text{:}1} \right)}}$${X\left( {1\text{:}1} \right)} = {\frac{854}{720}{X\left( {1.78\; \text{:}\; 1} \right)}}$

Conversion 2: Conversion between the resolution of 854×480 and 640×480having a 1×1 unit pixel aspect ratio. In the case of interactivecontents manufactured to a 854×480 size, all contents cannot bedisplayed on a 640×480 display, and thus only an area (corresponding to“hot area”) corresponding to a 640×480 size are selected using viewportand displayed on the 640×480 display. When interactive contentsmanufactured to a 640×480 size are displayed on a 854×480 display, allcontents are displayed in a 640×480 area, and the other 214×480 area isfilled with a background color. That is, when the interactive contentsof 854×480 are displayed on the 640×480 display, the viewport are of theinteractive contents needs to be well selected. When the interactivecontents of a 640×480 size are displayed on the 854×480 display, thewindow area of the display needs to be well selected.

Conversion 3: The resolution of 720×480 having a 4×3 pixel aspect ratiois converted into a shape having a 1×1 unit pixel aspect ratio. Totalhorizontal resolution=normalization (when the length ratio of the unitpixel is 1, a width ratio, total vertical resolution)=when the lengthratio of the unit pixel is 1, a width ratio×total horizontalresolution=1.33×480=around 640.

Therefore, the resolution of a 720×480 size having a 4×3 pixel aspectratio is consistent with the resolution of a 640×480 size having a 1×1unit pixel aspect ratio. That is, when converting into a shape usingconversion 3, the following Equation is formed:

${X\left( {1.33\; \text{:}\; 1} \right)} = {\frac{720}{640}{X\left( {1\text{:}1} \right)}}$${X\left( {1\text{:}1} \right)} = {\frac{640}{720}{X\left( {1.33\; \text{:}\; 1} \right)}}$

Conversion 4: Conversion between the resolution of a 720×480 size havinga 16×9 pixel aspect ratio and the resolution of 720×480 having a 4×3pixel aspect ratio. The following Equation is formed between thehorizontal resolution having the 4×3 (12×9) pixel aspect ratio and thehorizontal resolution having the 16×9 pixel aspect ratio.

${X\left( {1.78\; \text{:}\; 1} \right)} = {\frac{12}{16}{X\left( {1.33\text{:}1} \right)}}$${X\left( {1.33\text{:}1} \right)} = {\frac{16}{12}{X\left( {1.78\; \text{:}\; 1} \right)}}$

That is, it is most appropriate that the 720×480 resolution in thedisplay having a 4×3 screen size is displayed in 540×480 resolution inthe display having the 16×9 size, and thus when only an area(corresponding to the “hot area”) corresponding to 540×480 in theinteractive contents for 16×9 is selected, the selected area iscorrectly displayed on the display having a 4×3 screen size.

Meanwhile, if the 720×480 resolution having the 16×9 pixel aspect ratiois converted into a letter box shape in the 720×480 resolution havingthe 4×3 pixel aspect ratio, a vertical resolution is varied. Thus, thefollowing Equation is formed between the vertical resolution having the4×3 (16×12) pixel aspect ratio and the vertical resolution having the16×9 pixel aspect ratio.

${Y\left( {1.33\; \text{:}\; 1} \right)} = {\frac{9}{12}{Y\left( {1.78\text{:}1} \right)}}$${Y\left( {1.78\text{:}1} \right)} = {\frac{12}{9}{Y\left( {1.33\; \text{:}\; 1} \right)}}$

That is, the size of the window area in the display having the 4×3 sizeshould be 720×360 so that the 720×480 resolution for the 16×9 size ismaintained at a 16×9 size and is displayed on the display having the 4×3size.

As above, when the AV data and the markup document are manufactured bythe manufacturer at one aspect ratio on the basis of conversion methodsperformed in a case where the ratio of a unit pixel size is different,their contents are displayed according to aspect ratios of the displays,as shown in the following table.

For reference, in the following table, the size of a pixel in each caseis set to 1×1 on the basis of the above-mentioned conversion relation.Thus, it is assumed the resolution having the 4×3 aspect ratio to640×480, and the resolution having the 16×9 aspect ratio to 854×480. Inaddition, in the embedded mode or PIP mode, it is assumed that AV datafor the 4×3 size is displayed in an area of 200×150, and AV data for the16×9 size is displayed in an area of 272×153.

Viewport size Window size Contents Reproduction Markup AV Markup AVmanufactured Display mode document data Document data 4 × 3 markup 4 × 3Embedded 640 × 480 640 × 480 640 × 480 determined document, mode byobject 4 × 3 AV tag data Background 640 × 480 640 × 480 640 × 480 640 ×480 Mode PIP mode 640 × 480 640 × 480 640 × 480 200 × 150 16 × 9 Embedded 640 × 480 640 × 480 640 × 480 determined mode by object tagBackground 640 × 480 640 × 480 640 × 480 640 × 480 mode PIP mode 640 ×480 640 × 480 640 × 480 200 × 150 4 × 3 markup 4 × 3 Embedded 640 × 480854 × 480 640 × 480 determined document, Mode by object 16 × 9 AV tagdata Background 640 × 480 640 × 480 640 × 480 640 × 480 mode (P) PIPmode 640 × 480 854 × 480 640 × 480 200 × 150 16 × 9  Embedded 640 × 480854 × 480 640 × 480 determined mode by object tag Background 640 × 480854 × 480 640 × 480 854 × 480 mode PIP mode 640 × 480 854 × 480 640 ×480 272 × 153 16 × 9  4 × 3 Embedded 640 × 480 640 × 480 640 × 480determined markup mode by object document, tag 4 × 3 AV Background 640 ×480 640 × 480 640 × 480 640 × 480 data mode PIP mode 640 × 480 640 × 480640 × 480 200 × 150 16 × 9  Embedded 854 × 480 640 × 480 854 × 480determined mode by object tag Background 854 × 480 640 × 480 854 × 480640 × 480 mode PIP mode 640 × 480 640 × 480 854 × 480 200 × 150 16 × 9 4× 3 Embedded 640 × 480 854 × 480 640 × 480 determined markup mode byobject document, tag 16 × 9 AV Background 640 × 480 640 × 480 640 × 480640 × 480 data mode (P) PIP mode 640 × 480 854 × 480 640 × 480 200 × 15016 × 9  Embedded 854 × 480 854 × 480 854 × 480 determined mode by objecttag Background 854 × 480 854 × 480 854 × 480 854 × 480 mode PIP mode 854× 480 854 × 480 854 × 480 272 × 153

In the above table, (P) indicates a pan-and-scan shape.

A scene in which 16×9 AV data is synthesized with a 4×3 markup documentbased on the above table is displayed on a display having a 16×9 screensize as follows. In an embedded mode, as shown in FIG. 22A, the 16×9 AVdata synthesized with a 16×9 markup document is displayed in theembedded mode. In a background mode, as shown in FIG. 22B, the 16×9 AVdata synthesized with the 16×9 markup document is displayed in thebackground mode. In a PIP mode, as shown in FIG. 22C, the 16×9AV datasynthesized with the 16×9 markup document is displayed in the PIP mode.

Reproducing methods according to an aspect ratio according to a yetstill another embodiment of the present invention are largely classifiedby the static method using the CSS and a dynamic method using the APIfor the DOM. When the interactive contents are initially displayed in ascene, the interactive contents are displayed on a display through thestatic method using the default style sheet in the presentation engine 3or the CSS defined by a “link” tag and a “style” tag in the markupdocument. However, when the aspect ratio is changed by a user's inputduring reproduction, the aspect ratio of an output screen can bedynamically changed by adding an aspect ratio conversion function usinga script language to the markup document using the API for a DOM.

Hereinafter, the static method using the @screen-display rule will bedescribed. Properties, such as viewport and window for a markup documentand viewport and window for AV data, respectively, are defined in animproved @screen-display rule.

1. Screen-Display Type

4×3N: This case indicates that a user sets a screen output to a 4×3normal shape, and this shape is a reduced shape of 16×9 AV data in whichdistortion in which a scene seems to be slim does not occur, unlike aconventional normal shape.

4×3L: If a user sets a screen output to a 4×3 letter box shape

4×3P: If a user sets a screen output to a 4×3 pan-and-scan shape

16×9W: If a user sets a screen output to a 16×9 wide shape

2. “Video-Placement” Property

Video-placement property designates a display mode of the AV scene. Themodes include none, embedded, pip-#, and background representing nothingis displayed, embedded mode, PIP mode, and background mode,respectively. An initial value is an embedded mode.

3. Background-Color Property

Background-color property designates a background color of a sceneformed of a single color. A value is <color>, and an initial value mayvary according to a user agent (UA).

4. “Document-Viewport” Property

Document-viewport property designates a trimming area of a markupdocument. A value is <shape>, and an initial value is rect (0%, 100%,100%, 0%). Here, the value of the defined <shape> is rect(<top>,<right>, <bottom>, <left>).

5. “Document-Window” Property

Document-window property designates an area of a window in which amarkup document is displayed on a screen of a display. A value is<shape>, and an initial value is rect (0%, 100%, 100%, 0%).

6. “Video-Viewport” Property

Video-viewport property designates a trimming area of the scene in whichthe AV scene is synthesized with the markup document scene. A value is<shape>, and an initial value is rect (0%, 100%, 100%, 0%).

7. “Video-Window” Property

Video-window property designates an area of a window in which the AVdata is displayed on a screen of a display. A value is <shape>, and aninitial value is rect (0%, 100%, 100%, 0%).

An example of a style sheet manufactured using the type and property ofthe @screen-display rule described above is as follows.

A default style sheet has different shapes depending on a presentationengine 3 installed in a reproducing apparatus, and it cannot beguaranteed that a scene is displayed as the manufacturer wants. When themanufacturer wants to display the scene as one wishes, a CSS or othermechanism to convey how to display the scene should be added to a markupdocument. The following default style sheet is a default style sheetinstalled in the presentation engine 3 with an assumption that the AVdata and the markup document stored in a storage medium are manufacturedfor a 16×9 size. Values of <shape> used in the above example are basedon the above-mentioned (conversion between the resolution of 720×480having a 16×9 pixel aspect ratio and the resolution of 720×480 having a4×3 pixel aspect ratio).

@screen-display 4x3N {   background-color : #000000   document-viewport: (0px,629px,479px,90px)   document-window : (0px,719px,479px,0px)  video-viewport : (0px,719px,479px,0px)   video-window :(0px,719px,479px,0px) } @screen-display 4x3L {   background-color :#000000   document-viewport : (0px,719px,479px,0px)   document-window :(60px,719px,419px,0px)   video-viewport : (0px,719px,479px,0px)  video-window : (60px,719px,419px,0px) } @screen-display 4x3P {  background-color : #000000   document-viewport :(0px,629px,479px,90px)   document-window : (0px,719px,479px,0px)  video-viewport : (0px,629px,479px,90px)   video-window :(0px,719px,479px,0px) } @screen-display 16x9W {   background-color :#000000   document-viewport : (0px,719px,479px,0px)   document-window :(0px,719px,479px,0px)   video-viewport : (0px,719px,479px,0px)  video-window : (0px,719px,479px,0px) }

Since the default style sheet is differently set in each reproducingapparatus, a scene cannot be usually displayed as the manufacturerwants. Thus, preferably, the manufacturer makes an additional CSS in themarkup document and attaches the CSS to the document so that the AV dataand the markup document can be effectively displayed even at an aspectratio set by the user. The following example shows how the manufacturermakes the CSS in the markup document so that AV data for the 16×9 sizeand a markup document for the 4×3 size can be effectively displayed in a“background mode.” The CSS may be made using a “style” tag, as shown thefollowing example, and may be used through external reference using a“link” tag.

<!DOCTYPE html PUBLIC “-//DVD//DTD XHTML DVD-HTML 1.0//          EN”“http://www.dvdforum.org/enav/dtd/dvdhtml-1-          0.dtd”> <html>  <head>    <title>Example of aspect ratio change</title>    <styletype=“text/css”>    @screen-display 4x3N    {      video-placement :background      background-color : #000000      document-viewport :(0px,719px,479px,0px)      document-window : (0px,719px,479px,0px)     video-viewport : (0px,629px,479px,90px) // If the entire area isselected using a viewport area, AV data displayed as a background seemsto be slim. Thus, in order to solve this problem, the manufacturer justselects pan & scan. A selection area may be varied by the manufacturer.     video-window : (0px,719px,479px,0px)    }    @screen-display 4x3L   {      video-placement : background      background-color : #000000     document-viewport : (0px,719px,479px,0px)      document-window :(60px,719px,419px,0px)      video-viewport : (0px,719px,479px,0px)     video-window : (60px,719px,419px,0px)    }    @screen-display 4x3P   {      video-placement : background      background-color : #000000     document-viewport : (0px,719px,479px,0px)      document-window :(0px,719px,479px,0px)      video-viewport : (0px,629px,479px,90px) // Anarea formed by cutting the right and left sides of DVD-video will beselected.     video-window : (0px,719px,479px,0px)    }   @screen-display 16x9W    {      video-placement : background     background-color : #000000      document-viewport :(0px,719px,479px,0px)      document-window : (0px,629px,479px,90px) //In order to prevent a markup document from distorting, a window area isreduced.      video-viewport : (0px,719px,479px,0px)      video-window :(0px,719px,479px,0px)    }    </style>   </head>   <body id=“bodyNode”>  ......................................................................  </body> </html>

As above, the static method for displaying interactive contentsaccording to a screen aspect ratio using the default style sheet or theCSS attached to the document by the manufacturer has been described.

Hereinafter, a dynamic method using an object source code of the API forthe DOM will be described. The value of the object source code can bereferred to using a script language in the markup document.

The following object source code is used to bind“ScreenDisplayProperties” in root elements (i.e., <frameset> and <html>)of the uppermost level.

Interface ScreenDisplayProperties {   attribute ScreenDisplayRulescreenDisplayInfo; };

Here, “ScreenDisplayProperties” are connected to root elements of amarkup document, and the value of “ScreenDisplayProperties” can bereferred to using a script language in the markup document.

The definition and property of an interface definition language (IDL)are as follows.

IDL Definition Interface ScreenDisplayRule {   readonly attributeunsigned short screenDisplayMode;       attribute unsigned shortvideoPlacement;       attribute DOMString colorBackground;      attribute DOMString documentviewport;       attribute DOMStringdocumentwindow;       attribute DOMString videoviewport;       attributeDOMString videowindow;  }; Attributes   screenDisplayMode: An aspectratio of an output scene set by a user     const unsigned shortSCREEN_DISPLAY_MODE_4X3NORMAL = 0;     const unsigned shortSCREEN_DISPLAY_MODE_4X3LETTERBOX = 1;     const unsigned shortSCREEN_DISPLAY_MODE_4X3PAN&SCAN = 2;     const unsigned shortSCREEN_DISPLAY_MODE_16X9WIDE = 3;   videoPlacement: It designates adisplay mode of a DVD-video     const unsigned shortVIDEO_PLACEMENT_NONE = 0;     const unsigned shortVIDEO_PLACEMENT_EMBEDDED = 1;     const unsigned shortVIDEO_PLACEMENT_BACKGROUND = 2;     const unsigned shortVIDEO_PLACEMENT_PIP = 3;   colorBackground: It has the value of <color>as a background color of a DVD-video scene.   documentviewport: It hasthe value of <shape> as a trimming area of a markup document.  documentwindow: It has the value of <shape> as a window area on adisplay to which the trimmed markup document is to be mapped.  videoviewport: It has the value of <shape> as a trimming area of theDVD-video.   videowindow: It has the value of <shape> as a window areaon a display to which the trimmed DVD-video is to be mapped. However,when videoPlacement is in an embedded mode, the window area isrestricted by “width” and “height” defined by an <object> tag in themarkup document.

The above-mentioned dynamic definition using the object source of theAPI for the DOM is implemented by a script language included in themarkup document, as shown in the following example. The example is madeby the manufacturer by considering event handling according to user'saspect ratio conversion of AV data for 16×9 (i.e., DVD-video) and amarkup document for the 16×9 size, which are to be displayed in anembedded mode.

<?xml version =“1.0” encoding=“UTF-8”?> <!DOCTYPE html PUBLIC“-//DVD//DTD XHTML DVD-HTML 1.0//EN”       “http://www.dvdforum.org/envideo/dtd/dvdhtml-1-0.dtd”> <html>  <head>    <title>Example of aspect ratio change</title>    <scripttype=“text/javascript”>    <--      function eventHandler(evt)      {     var vdi;      if (evt.index == SCREEN_DISPLAY_MODE_CHANGE &&(evt.param1 == 0))      { // param1 == 0 : 4x3N       vdi =document.documentElement.ScreenDisplayInfo;       vdi.videoPlacement =1;       vdi.colorBackground = “black”;       vdi.documentviewport =“(0px,629px,479px,90px)”; // An area formed by cutting right and leftsides of a markup document is selected. In this case, it is mostpreferable that the selected area is consistent with a “hot area”.      vdi.documentwindow = “(0px,719px,479px,0px)”;      vdi.videoviewport = “(0px,719px,479px,0px)”       // In anembedded state, vdi.videowindow is determined by “width” and “height” ofan <object> tag in the markup document, and thus the manufacture setsthe size of the window of the “object” tag so that the DVD-video isdisplayed in a 16 × 9 size.      }      if (evt.index ==SCREEN_DISPLAY_MODE_CHANGE && (evt.param1 == 1))      { // param1 == 1 :4x3L       vdi = document.documentElement.ScreenDisplayInfo;      vdi.videoPlacement = 1;       vdi.colorBackground = “black”;      vdi.documentviewport = “(0px,629px,479px,90px)”;      vdi.documentwindow = “(0px,719px,479px,0px)”;      vdi.videoviewport = “(0px,719px,479px,0px)” // Even though theentire DVD-video picture is selected, in a 4 × 3 letter box mode, itseems that “Matte” is added to the upper and lower portions of a scene.     }      if (evt.index == SCREEN_DISPLAY_MODE_CHANGE && (evt.param1== 2))      { // param1 == 2 : 4x3P       vdi =document.documentElement.ScreenDisplayInfo;       vdi.videoPlacement =1;       vdi.colorBackground = “black”;       vdi.documentviewport =“(0px,629px,479px,90px)”;       vdi.documentwindow =“(0px,719px,479px,0px)”;       vdi.videoviewport =“(0px,629px,479px,90px)” // Part of a scene formed by cutting right andleft sides of the DVD-video picture will be selected.       }      if(evt.index == SCREEN_DISPLAY_MODE_CHANGE && (evt.param1 == 3))      { //param1 == 3 : 16x9W       vdi =document.documentElement.ScreenDisplayInfo;       vdi.videoPlacement =1;       vdi.colorBackground = “black”;       vdi.documentviewport =“(0px,719px,479px,0px)”;       vdi.documentwindow =“(0px,719px,479px,0px)”;       vdi.videoviewport =“(0px,719px,479px,0px)”      }      }     -->    </script>    <scripttype=“text/javascript”>    <--      function setupEventHandler( )      {     // eventHandler is registered to bodyNode and Interactive Contents     // SCREEN_DISPLAY_MODE_CHANGE == 500     bodyNode.addEventListener(“dvdvideo”,eventHandler,true);dvdVideo.SubscribeToEvent(SCREEN_DISPLAY_MODE_CHANGE,true);}    -->   </script>   </head>   <body id=“bodyNode” onload=“setupEventHandler()”>  ..........................................................................  </body> </html>

The markup document is displayed in a scene through the initial staticdefinition. Due to the occurrence of an event, such as the activation ofa user's aspect ratio conversion key (or button) input,“vdi.screenDisplayMode” information is read. Thus, the aspect ratio ofthe scene is reconstituted using a script language included in the abovemarkup document.

FIG. 23 shows a flowchart of another embodiment of a reproducing methodaccording to the present invention. Referring to FIG. 23, by using theabove-mentioned static and dynamic definitions, the markup documentscene is displayed according to a screen mode (aspect ratio, resolution,and video output method) set by the user or set in the reproducingapparatus. The screen mode can be changed even during reproductionthrough a user's input. Values of the viewport and the window of themarkup document and the AV data applied in this case can be applied to anext markup document if these values are not changed in a next markupdocument.

In operation 2301, the presentation engine 3 reads the screen mode(aspect ratio, resolution, and video output method) set in thereproducing apparatus or the screen mode set by the user. Here, a videooutput method is for a 16×9 video that is output in a 4×3 letter box or4×3 pan & scan, and 16×9 wide mode, which can be displayed without scenedistortion.

In this case, even though a display is set to a 4×3 size, in an embeddedmode or PIP mode, the AV decoder 2 does not output an AV stream in aletter box or pan-and-scan shape. Instead, the AV decoder outputs an AVstream for the 16×9 size, as if the display is set to a 16×9 size,without conversion. This is because the AV stream is generally encodedin the 16×9 size in the DVD reproducing apparatus.

In operation 2302, a default style sheet in the presentation engine 3 isselected based on the set screen mode. Properties, such as documentviewport, document window, video viewport, and video window which aredefined in the corresponding default style sheet, are determined. Thepresentation engine 3 interprets the markup document read by the readingunit 1 and checks a style sheet linked to or embedded in the markupdocument. In operation 2303, if there is no style sheet provided by themanufacturer in the markup document, the presentation engine 3 outputsthe markup document to a scene, using the properties such as documentviewport, document window, video viewport, and video window, which aredefined in the default style sheet selected based on the set screenmode. If there is a style sheet provided by the manufacturer in themarkup document, the presentation engine 3 outputs the markup documentto the scene, using the properties such as document viewport, documentwindow, video viewport, and video window, according to @screen-display,which are defined in the corresponding style sheet.

In operation 2304, it is determined whether the screen mode according toa user's aspect ratio conversion key (or button) is changed. Inoperation 2305, if the screen mode is changed by the user, thepresentation engine 3 informs the corresponding markup document of anaspect ratio conversion event ASPECT_RATIO_CHANGE. The presentationengine 3 executes a script caused by the event, interprets a screendisplay property variable corresponding to the changed screen mode usingScreenDisplayProperties in the presentation engine 3, changes a screenoutput state of the markup document based on the interpretedinformation, and outputs a new markup document to the scene. Inoperation 2306, if the screen mode is not changed in operation 2304, itis determined whether the output of the markup document is terminated.

The above recording and reproducing methods can be implemented with acomputer program. Program codes and code segments of the computerprogram can be made by a computer programmer skilled in the art. Also,the above program is stored in information storage media (computerreadable media), read and executed by the computer, thereby performing amethod for recording and reproducing a markup document and AV data. Theinformation storage media include magnetic recording media, opticalrecording media, and carrier waves and in other forms such as firmware.

As described above, according to the present invention, an informationstorage medium including AV data and a markup document so that the AVdata and the markup document can be displayed in various ways in aninteractive mode that is responsive to the resolution and the aspectratio (screen ratio). A recording method, a reproducing method, and areproducing apparatus therefore are provided. As such, the user canenjoy a fine display scene. Further, a contents manufacturer and arecording and reproducing apparatus manufacturer can increase/reduce themarkup document scene using the window and viewport properties, therebysparing an available memory space and providing a special function, suchas a scroll function. In addition, part of the AV scene can be increasedor reduced using the property video-viewport, and interactive contentsmanufactured at one fixed screen ratio can be changed into variousscreen ratios, using the viewport and window properties for interactivecontents.

According to the present invention, when the interactive contentsmanufactured at the fixed screen ratio are reproduced by the reproducingapparatus using the markup language, the interactive contents can beeffectively displayed without a portion from which important informationis subtracted, regardless of the screen ratio of the display, therebysimplifying an authoring process, avoiding contents overlapping and moreeffectively using a disc space.

In addition, the AV data and the markup document manufactured at thefixed aspect ratio can be effectively displayed on the display havingvarious aspect ratios through a static method using a CSS related to anaspect ratio, and a dynamic method using a script language in the markupdocument using an API for a DOM. Thus, the user can enjoy a displaystate that is closest to a manufacturer's intention, and themanufacturer can more effectively use the storage medium by avoidinginteractive contents overlapping.

While this invention has been particularly shown and described withreference to embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the invention as definedby the accompanying claims, and equivalents thereof.

1. A method of recording AV data on an information storage medium, themethod comprising: recording the AV data including audio data and videodata to be displayed as an AV scene; recording a markup document to bedisplayed as a markup document scene together with the AV scene; andrecording scene synthesis information which describes and differentiatesbetween display modes which display the markup document scene and the AVscene together as an interactive scene.
 2. The method of claim 1,wherein the recording the scene synthesis information comprisesrecording a style sheet file associated with the markup document.
 3. Themethod of claim 1, wherein the recording the scene synthesis informationcomprises recording a cascading style sheet (CSS) file which is one oflinked to and embedded in the markup document.
 4. The method of claim 3,wherein: the recording the AV data comprises recording the AV data in avideo directory, the recording the markup document comprises recordingthe markup document in an interactive directory, and the recording thescene synthesis information comprises recording the scene synthesisinformation in the interactive directory.
 5. The method of claim 3,wherein the screen synthesis information includes at least one of:screen display type information which designates an aspect ratio of acombined scene in which the AV scene is combined with the markupdocument scene, display mode designation information which designates adisplay mode of the AV scene, background color designation informationwhich designates a background color of the combined scene, trimming areadesignation information of a trimming area of the combined scene inwhich the AV scene is combined with the markup document scene, windowdesignation information which designates a window in which the combinedscene is to be displayed on a screen of a display, and AV trimming areadesignation information which designates an area in which to one ofincrease and reduce a desired portion of the AV scene.
 6. The method ofclaim 5, wherein the display mode designation information indicates atleast one of: an embedded mode in which the AV scene is embedded in atleast part of the markup document scene, a picture in picture (PIP) modein which the AV scene overlaps the markup document scene, and abackground mode in which the markup document scene overlaps the AVscene.
 7. The method of claim 5, wherein the recording the markupdocument comprises recording data designating a first area of the AVscene in which contents which are to be displayed in a maximum areashown regardless of an aspect ratio of the display, and other areas inwhich other contents are to displayed according to the aspect ratio ofthe display.
 8. The method of claim 7, wherein, when the markup documenthas a first aspect ratio and a first resolution is to be displayed onthe display having a second aspect ratio and a second resolution lowerthan the first resolution, the first area is selected using the trimmingarea designation information of the synthesized scene, and the selectedfirst area is mapped to a designated area on the screen of the displayusing the window designation information of the synthesized scene. 9.The method of claim 5, wherein the scene synthesis information furtherincludes window designation information of the AV scene which designatesa window in which the AV scene is to be displayed on the screen of thedisplay.
 10. The method of claim 3, wherein the recording the scenesynthesis information comprises recording an object having propertyvariables to control the CSS and a program used to control the CSS onthe basis of the object.
 11. The method of claim 10, wherein theproperty variables include at least one of: a screen display mode whichdesignates an aspect ratio of a combined scene in which the AV scene iscombined with the markup document scene, a property which designates adisplay mode of the AV scene, a property which designates a backgroundcolor of the combined scene, a property which designates a trimming areaof the combined scene in which the AV scene is combined with the markupdocument scene, a property which designates a window in which thecombined scene is to be displayed on the screen of the display, and aproperty which designates a trimming area in which to one of increaseand reduce a desired portion of the AV scene.
 12. The method of claim11, wherein program is responsive to a received screen mode conversioncommand such that, when the screen mode conversion command is received,the program uses an object source to control the property whichdesignates the trimming area of the combined scene, the property whichdesignates the window area of the combined scene, and the property whichdesignates the trimming area of the AV scene according to the screendisplay mode so as to change the aspect ratio of the combined scene. 13.The method of claim 10, wherein the property variables include at leastone of: a screen display mode which designates an aspect ratio of acombined scene in which the AV scene is combined with the markupdocument scene, a property which designates a display mode of the AVscene, a property which designates a background color of the scene, aproperty which designates a trimming area of the markup document scene,a property which designates a window in which the markup document sceneis displayed on the screen of the display, a property which designates atrimming area in which to one of increase and reduce a desired portionof the AV scene, and a property which designates a window in which theAV scene is displayed on the screen of the display.
 14. The method ofclaim 13, wherein the program is responsive to a received screen modeconversion command such that, when the screen mode conversion command isreceived, the program uses an object source to control the propertywhich designates the trimming area of the markup document scene, theproperty which designates the window area of the markup document scene,the property which designates the trimming area of the AV scene, and theproperty which designates the window of the AV scene area according tothe screen display mode so as to change the aspect ratio of the combinedscene.
 15. A method for reproducing AV data recorded on an informationstorage medium, the AV data including audio and video data, the methodcomprising: interpreting a markup document to be displayed as a markupdocument scene together with an AV scene to be displayed from the AVdata; interpreting scene synthesis information which describes anddifferentiates between display modes used to display the markup documentscene and the AV scene together; and displaying the AV scene and themarkup document scene in a combined scene according to a selected one ofthe display modes according to the interpreted scene synthesisinformation.
 16. The method of claim 15, wherein the displaying the AVand markup document scenes includes embedding the AV scene in at leastpart of the markup document scene.
 17. The method of claim 15, whereinthe displaying the AV and markup document scenes includes using apicture in picture (PIP) technique so as to overlap the displayed AVscene on the displayed markup document scene.
 18. The method of claim15, wherein the displaying the AV and markup document scenes includesoverlapping the AV scene and the markup document scene.
 19. The methodof claim 15, wherein the interpreting the scene synthesis informationincludes interpreting a style sheet file linked to or embedded in themarkup document.
 20. The method of claim 19, wherein the interpretingthe scene synthesis information comprises: interpreting a link tag whichinformation refers to a cascading style sheet (CSS) file and calling theCSS file; and interpreting the called CSS file.
 21. The method of claim20, wherein the interpreting the called CSS file comprises readingdisplay mode designation information which designates a display mode ofthe AV scene, and trimming area designation information which designatesan area to increase and reduce a desired portion of the AV scene. 22.The method of claim 21, wherein the interpreting the called CSS filefurther comprises reading: screen display type information representingan aspect ratio of the combined scene in which the AV scene is to becombined with the markup document scene, background color designationinformation which designates a background color of the scene, trimmingarea designation information of a trimming area of the combined scene inwhich the AV scene is to be combined with the markup document scene, andwindow designation information which designates a window in which thecombined scene is to be displayed on a screen of a display.
 23. Themethod of claim 20, wherein the interpreting the called CSS file furtherincludes reading: screen display type information indicating an aspectratio of the combined scene in which the AV scene is combined with themarkup document scene, background color designation information whichdesignates a background color of the combined scene, markup documenttrimming area designation information which designates a trimming areaof the markup document scene, markup document window designationinformation which designates a window in which the markup document is tobe displayed on a screen of a display, AV trimming area designationinformation which designates an area in which to one of increase andreduce a desired portion of the AV scene, and AV scene windowdesignation information which designates a window in which the AV sceneis displayed on the screen of the display.
 24. The method of claim 21,wherein the interpreting the scene synthesis information furtherincludes: interpreting a program which uses an object having propertyvariables to control the CSS, and controlling the CSS using the program.25. The method of claim 24, wherein the interpreting the program furtherincludes, according to a received input, using the program and theobject to control one of the property variables which designates adisplay mode of the AV scene and another of the property variables whichdesignates a trimming area of the AV scene so to one of increase andreduce a desired portion of the AV scene.
 26. The method of claim 24,wherein the interpreting the program further includes, in response to areceived screen mode conversion command, using the program and theobject to control one of the property variables which designates atrimming area of the combined scene, another of the property variableswhich designates a window area of the combined scene, and an additionalone of the property variables which designates a trimming area of the AVscene according to the screen display mode so as to change the aspectratio of the combined scene.
 27. The method of claim 24, wherein theinterpreting the program further includes, in response to a receivedscreen mode conversion command, using the program and the object tocontrol one of the property variables which designates a trimming areaof the markup document scene, another one of the property variableswhich designates a window area of the markup document scene, anadditional one of the property variables which designates a trimmingarea of the AV scene, and a further one of the property variables whichdesignates a window area of the AV scene according to the screen displaymode so as to change the aspect ratio of the combined scene.
 28. Amethod of reproducing AV data, which includes audio data and video datahaving a predetermined aspect ratio and is recorded on an informationstorage medium, and a markup document having a predetermined aspectratio, the method comprising: reading scene synthesis informationcorresponding to a scene mode set by one of a reproducing apparatus anda user; interpreting the read scene synthesis information; using theread scene synthesis information to display a combined scene includingan AV scene, reproduced using the reproduced AV data, and a markupdocument scene, reproduced using the markup document; and changing anoutput state of the markup document scene in response to a scene modechange.
 29. The method of claim 28, wherein: the interpreting the readscene synthesis information includes: selecting a default style sheet inthe reproducing apparatus on the basis of a set scene mode, interpretingfirst information defined in the selected default style sheet, anddetermining whether a style sheet is linked to or embedded in the markupdocument, the using the read scene synthesis information to display thecombined scene comprises: if it is determined that there is no stylesheet in the markup document, displaying the markup document using thefirst information in the default style sheet, and if it is determinedthat there is the style sheet in the markup document, displaying themarkup document using second information defined in the style sheet, andthe first and second information each include trimming area designationinformation which designates a trimming area of the AV scene and themarkup document scene, window designation information which designates awindow in which the combined scene is to be displayed on the screen of adisplay, and AV trimming area designation information which designatesan area in which to one of increase and reduce a desired portion of theAV scene.
 30. The method of claim 29, wherein the using the read scenesynthesis information to display the combined scene further comprises:determining whether the scene mode is to be changed according to areceived command, if the scene mode is to be changed, transmitting scenemode change control information to the markup document and executing ascript therefrom, and in response to the scene mode change, changing theoutput state of the markup document scene using screen displayproperties.
 31. The method of claim 30, wherein the changing the outputstate of the markup document scene includes: in an embedded mode of aninteractive mode or a PIP mode, outputting the AV data at a first aspectratio and a first resolution when the AV scene having the first aspectratio is to be displayed on the display having a second aspect ratio anda second resolution lower than the first resolution, and in a backgroundmode of the interactive mode or video mode, outputting the AV data tocreate the AV scene in a pan-and-scan or letterbox shape.
 32. The methodof claim 29, wherein: the interpreting the read scene synthesisinformation includes further comprises: selecting the default stylesheet in the reproducing apparatus on the basis of a set scene mode;reading third information defined in the selected default style sheet,and determining whether the style sheet is linked to or embedded in themarkup document, the using the read scene synthesis information todisplay the combined scene comprises if it is determined that there isno style sheet in the markup document, displaying the markup documentusing the third information in the default style sheet, and if it isdetermined that there is the style sheet in the markup document,displaying the markup document using fourth information defined in thecorresponding style sheet, and the third and fourth information eachincludes markup document window designation information which designatesa window in which the markup document scene is to be displayed on thescreen of the display, markup document trimming area designationinformation which designates a trimming area of the markup documentscene, and AV window area designation information which designates awindow in which the AV scene is to be displayed on the screen of thedisplay.
 33. The method of claim 32, wherein the using the read scenesynthesis information to display the combined scene further comprises:determining whether the scene mode is to be changed according to areceived command, if the scene mode is to be changed, transmitting scenemode change control information to the markup document and executing ascript therefrom, and in response to the scene mode change, changing theoutput state of the markup document scene using screen displayproperties.
 34. The method of claim 33, wherein the changing the outputstate of the markup document scene includes, when the AV data having afirst aspect ratio and a first resolution is to be displayed on thedisplay having a second aspect ratio and a second resolution lower thanthe first resolution, outputting the AV data without conversion usingthe markup document trimming area designation information and the markupdocument window area designation information of the markup documentscene and the AV trimming area designation information and the AV windowarea designation information of the AV scene.